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ABSTRACT 


Yamabico-11 is an autonomous mobile robot used as a research platform with one 
area in image understanding. Previous work focused on edge detection analysis on a Silicon 
Graphics Iris (SGI) workstation with no method for implementation on the robot. 
Yamabico-11 does not have an on-board image processing capability to detect straight 
edges in a grayscale image and a method for allowing the user to analyze the data. 

The approach taken for system development is partly based on edge extraction and 
line fitting algorithms of [PET92] with a 3-D geometric model of the robot's world 
[STE92]. Image grabbing routines of [KIS95] were used to capture images with the robot's 
digital output camera and processed using image understanding routines developed for a 
SGI workstation. The routines were modified and ported onto the robot. 

The new method of edge extraction produces less ambient noise and more 
continuous vertical line segments in the gradient image which enhances pattern matching 
analysis of the image. Yamabico-ll's computer system can capture an image with a 
resolution of 739 x 484 active picture elements. Edge detection analysis is performed on 
the robot which generates a list structure of edges and stored in the robot's memory for user 


analysis. 
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I. INTRODUCTION 


A. BACKGROUND 


Image understanding developments in the field of computer vision has provided 
advanced research capabilities for image processing applications in medicine, cartography, 
industry, manufacturing, printing and publishing, and numerous scientific fields. In all 
cases image processing is concerned with the computer processing of pictures or images 
that have been converted to anumeric form. The ability to process images in this format is 
the fundamental study and framework for image understanding of a vision system for an 
autonomous mobile robot. 

The study of robot vision has been of significant research at the Naval Postgraduate 
School in the last five years. While many of the basic approaches have undergone 
progressive refinement, numerous new directions continue to be pursued in both general 
and system specific applications. A vision system for an autonomous vehicle may be 
employed for a variety of uses including navigation, object recognition, and environmental 
mapping [DEC93]. 

In previous image understanding research, techniques were developed to 
implement a working vision based navigation control mechanism [PET92], to provide a 
capability for object recognition [DEC93], and integration of self contained image 


understanding subsystem independent of a unix workstation [KIS95]. 


B. OVERVIEW 


Yamabico-11,1s an autonomous mobile robot used as a test platform for research in 
motion planning, obstacle avoidance, environment exploration, path tracking, and image 
understanding. The ability to process images instantaneously or in real-time is crucial for 
navigating in a dynamic world. The ultimate goal of the image processing system in 


Yamabico-11 must be able to assess the environment and navigate with a safe and smooth 


motion. This research develops an edge region finding algorithm and implements this 


system into the board of the Yamabico-11. 


C. PROBLEM STATEMENT 


The major problems addressed in this research is how to develop and implement an 
image understanding system previously written for a Silicon Graphics Iris (SGI) 
workstation in an autonomous mobile robot. The resulting image understanding system 
should be a part of the total intelligent autonomous robot and should provide functionality 


that will allow the robot to process images on board in real-time. 


II. YAMABICO-11 ROBOT 


Yamabico-1l shown in Figure 1, 1s an autonomous mobile robot used as a test 
platform for research in motion planning, obstacle avoidance, environment exploration, 


path tracking, and image understanding. 
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Figure 1. Yamabico-11 Autonomous Mobile Robot. 


A. HARDWARE DESCRIPTION 


Yamabico-11 is powered by two 12-volt wheelchair type batteries and is driven on 
two wheels by DC motors which drive and steer the robot while four spring-loaded caster 


wheels provide balance. 


The master processor is an Ironic's SPARC-4 processor equivalent to a CPU Sun- 
3 workstation. This processor has 16 megabytes of main memory and runs with a clock 
speed of 33MHz on a VME bus. 

All programs on the robot are developed using a Sun 3/60 workstation and UNIX 
operating system. These programs are first compiled and then downloaded to the robot via 
a RS-232 link at 9600 baud rate using a PowerBook?" 145 computer for the communication 
interface. 

Twelve 40 kHz ultrasonic sensors are provided as the primary means by which the 
robot senses its environment. The sonar subsystem is controlled by an 8748 micro- . 
controller. Each sonar reading cycle takes approximately 24 milliseconds. 

The visual images from the robot are generated by a COHU solid state camera. The 
camera is mounted along the center line of the robot at a height of 34 inches. This camera 
provide black and white video to a display monitor and to the IMS board for processing and 
further display on the NEC multisync monitor shown in Figure 2. 

The JVC TK870U CCD camera equipped with a FUJINON TV zecm lens provides 
a NTSC standard RGB video image through a video fran... attached to a Silicon Graphics 
Iris™ (SGI) workstation shown in Figure 2. This video image is used to process images on 
the SGI only. The framer digitizes the sync and composite signals for storage on the SGI 
and also passes the signal to a high definition monitor. The video signal is transmitted via 
standard coaxial video cable to the image processing hardware. 

The Cohu4110 from Cohu Inc. [COH90] is a digital output camera with a 1/2 inch 
format Charge Couple Device (CCD) image sensor. The area is 6.4 mm x 4.8 mm and 739 
x 484 picture elements. The camera transfers in parallel one eight bit pixel which represents 
256 shades of gray. The digital output eliminates the need for special hardware to convert 
the cameras analog signal into digital. This design also isolates sensitive analog circuits 


away from the host computer by putting them into the camera itself. 
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Figure 2. Vision system hardware components. 


B. SOFTWARE DESCRIPTION 


The software system consists of a kernel and a user program. The kernel is 
approximately 82,000 bytes and only needs to be downloaded once during the course of a 
given experiment. The user's program can be modified and downloaded quickly to support 
rapid development. 

Motion and sonar commands are issued by the user 1n MML, the model-based 
mobile robot language. While the previous version of MML was based on point-to-point 
tracking, the current version being integrated into Yamabico's control structure relies on a 
‘path tracking’ approach. While MML provides the capability to define path types which 
include parabolic and cubic spiral, the most fundamental 'path' for the robot to follow is a 
line which is defined by a curvature (K) and a location and orientation in two-dimensional 
space described in x, y, and theta. With K-O, the line is straight, and KzÓ produces a circle 
of radius 1/K (K«0 s clockwise & K»0 z counter-clockwise). The location and orientation 


can be the starting point of a semi-infinite line called a forward line (fline), the end point of 


a semi-infinite line called a backward line (bline), or a point and direction along an infinite 
line (Jine). For all path types, once one has been specified and commanded, the robot 
performs the required calculations and adjusts the curvature of its motion as necessary. 
Additionally, transitions between successive paths are performed automatically and 
autonomously. 

The functionality inherent in the MML plays a significant role in developing the 
capability for the robot to avoid obstacles. Consequently, a portion of this research effort 
was devoted to implementing some of the core functions in the newly developed ‘path 
tracking’ approach to motion control. This method allows for dynamic real-time 
specification of the proposed robot path based on sensory input and is especially well suited 
to employing the information generated from object recognition. Since the available 
information will include not only ranges (which is the sole data provided by sonar) but also 
dimensions, a complete avoidance maneuver can be determined. 

As mentioned above, the sonar system is also controlled through the MML. Both 
raw sonar range returns as well as processed ‘global’ results incorporating least-squares 
line fitting are available to the user on board the robot. This capability should prove 
particularly useful in extending the environment in which the vision system can be applied, 


and its application is addressed in the discussion of the environmental model. 


IIl. IMAGE DESCRIPTION 


An image is a picture, photograph, display, or other form of visual representation 
of an object or scene. However, in digital 1mage processing, it has another meaning: an 


image is a two dimensional array of numbers [NIB86]. 


A. MATRIX STRUCTURE 


Since a digital image is similar to a matrix or array of numbers, the image can be 
represented by a structure called a bound matrix [DOUS7]. The array type structure used 


to describe the images for segment extraction is shown in Figure 3 where: 


- P (i,j) indicates the light intensity of the picture element and is a 


non-negative value. 


- P (6, 0) is considered to be the origin. 
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Figure 3. Bound matrix representation of image. 


The numbers used for the light intensity of the pixel gives its level of darkness or 
lightness of the pixel area. Since each pixel is stored as a byte, 8 bits, the maximum pixel 
value is 255. This topic of pixel storage will be discussed in the next section on RGB 
Format. A higher number represents a lighter area with the maximum value 255 being 


white and O being black. All intermediate values will be shades of grey. 


A 12 by 12 matrix shown in Figure 4 was used to represent an example image with 
different levels of light intensities. The array of numbers represented in the matrices were 
used to evaluate edge region generation and linear feature extraction discussed in the next 


section. The source code and results can be seen in Appendix A. 


150 150 150 150 150 150 150 150 150 150 150 150 
150 150 150 150 150 150 150 150 150 150 150 150 
150 150 150 150 150 150 150 150 150 150 150 150 
150 150150 0 0 0 O O 0 150 150 150 


150 150 150 O 0 0 O O GO) 150°150 150 
150 150 150 0 0 O O O 0 150 150 150 
15015015000 0 O O O 0 150 150 150 
150150150 0 0 0 O O O 150 150 150 


150 150150 0 0 0 O O 0 150 150 150 
150 150 150 150 150 150 150 150 150 150 150 150 
150 150 150 150 150 150 150 150 150 150 150 150 
150 150 150 150 150 150 150 150 150 150 150 150 


Figure 4. 12 x 12 matrix of pixel intensities of a square image. 


B. RGB FORMAT AND GRAYSCALE CONVERSION 


A single pixel is described in a RGB format which is comprised of 32 bits. The basic 
color components of each pixel in the image are red, green, and blue and are each 
represented by a byte, 8 bits. This gives an intensity value a range of O to 255 for each 
component. The alpha component, which represents the transparency of the pixel, is not 
considered when using the RGB format since all pixels are taken to be completely opaque. 
As was discussed earlier, an intensity value of zero represents a black pixel and an intensity 


value of 255 represents a white pixel. Figure 5 shows the bit placement for the RGB format. 


ALPHA BLUE GREEN 
31 23 l l 0 


Figure 5. The RGB Format. 


Bits 


The data for all the pixels in an image is stored in a long, one-dimensional array. 
The ordering in the array with regard to position in the image is left to right, bottom to top 
so the lower left corner pixel would be the first element in the array while the upper right 
would be the last. Since the edge extraction process requires a black and white (*grayscale”) 
representation for the pixels in an image, a conversion from the RGB values is necessary. 
According to the standard weighting factors set by the National Television Systems 
Committee (NTSC), a RGB color pixel is given an equivalent grayscale value by the 


following equation: 


Red Intensity 
GRAYSCALE = [0.299 0.587 0.114] Green Intensity (Eq 1) 
Blue Intensity 


C. GRADIENT IMAGE 


The previous example of the matrix image in Figure 4 of different light intensities 
were simplified in order to evaluate the region finding and linear fitting algorithms. Using 
an array of numbers in the matrix, we could represent different light intensities called 
grayscale values. The gradient image would simulate contrasting regions between the areas 
of similar light intensities within the image. This simplification allowed for the evaluation 
of the region finding and line extraction algorithms prior to testing them in a real and more 
complex image such as Figure 6. Figure 7 shows the gradient image as a result of applying 


the edge extraction algorithm to the input image in Figure 6. 
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Figure 7. Gradient image of hallway with chair. 
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IV. EDGE EXTRACTION 


A. GRADIENT-TYPE EDGE DETECTORS 


The gradient-type edge detectors are used to determine pixel gradients. Two partial 
difference operators, one for determining the change of pixel intensities in the horizontal 
(dx) direction and another for the vertical direction, must be specified. Gradient-type edge 
detectors are square matrices of weights, mapped onto a group about a central pixel or 
point. The weights are multiplied with the intensities of the eight surrounding pixels and 
then summed to provide values for the intensity changes in the horizontal and vertical axes. 
Commonly used gradient-type edge detectors are Prewitt, Sobel, and Roberts gradients 


[BAL82] shown in Figures 7 through 10. 





Figure 9. Sobel gradient edge detectors. 





Figure 10. Roberts gradient edge detectors. 


A modified Sobel gradient edge detector with values of E vice 2 for weights of 
the non-diagonal pixels in Figure 10 is used to compensate for a two-dimensional plane of 
pixels evenly spaced in both horizontal and vertical directions. The modified Sobel gradient 


tends to reduce the effects of noise. 





Figure 11. Modified Sobel gradient edge detector. 


1. Pixel Gradient Computation 
To compute the pixel gradient magnitude, we let P be the set containing the eight 


surrounding pixels P with indices (i,j) known as location P(i,j) shown in Figure 11. 
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Figure 12. The set P of all eight pixels surrounding pixel P(i,)). 
We define the bi-directional gradients gx(5j) and gy(ij) by multiplying the 


corresponding weights in the Sobel edge detector matrix by the corresponding pixel 


intensity values in P. 


gp SS MISERE 
*tP(i*1j-1)* 2P(i * ly) * P(i - ly * 10) 


(Eq 2) 


g (ij) = PG- lj D) *2PGj * 1) e P 1j 1) 
PG = ly ieee Deen) OC ED) 


(Eq 3) 


The bidirectional gradients gx(i,j) and gy(ij) represent the change in pixel 
intensities in the horizontal direction (dx) and the vertical direction (dy) at pixel location 


P(i,j). With these gradient components, the pixel Gradient Magnitude G(1,j) is calculated by 


Gli) = A (6) ^ * (e, G^ (Eq 4) 


and the Gradient Direction ®(i,) is calculated by 


P(ij) = atan2 (g, (iy), g,(iJ) (Eq 5) 


where atan2 is the subroutine function defined in Appendix A. 


B. PROPERTIES OF AN EDGE REGION 


We define the edge region as that boundary where the intensity level of the pixels 
is changing rapidly or whose pixels has a significant gradient magnitude. A pixel that has 
been included in the edge region must be significant, i.e. have a gradient magnitude greater 
than the specified threshold value. Threshold value can be determined dynamically by 
scanning the image once and computing the average weight of pixel intensities or by 
maintaining a histogram of previous images' average pixel intensities. For any two pixels 
to belong to an edge region, the pixels must be adjacent to each other and the pixels must 
have close gradient direction angles. We define closeness as the difference between the two 
pixel's gradient direction angles as being less than some constant angle 9 . 

A portion of an image with the edge region R between two distinct areas of common 
light intensity (areas A and B) is shown in Figure 12. Pixels included in the edge region R 
will have an average gradient direction angle close to the normal of the line segment 


describing that region. 
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Figure 13. Edge region between two areas of common light intensity. 


A pixel will not be included in the edge region if its gradient angle is not close to 


the region's average gradient angle avg. Thus, determining the pixels gradient angle and 
comparing the regions average gradient angle is crucial to the initial process of edge 
detection. 

Another important property of the edge region is the number of pixels that have 
been included in the region. Regions that consists of relatively small amounts of pixels 
produces a line extraction image with many broken line segments. One cause for generating 
regions with a relatively small amount of pixels can be attributed to random variations in 


the image, termed noise [BAL82]. 


C. EDGE REGION ALGORITHM 


1. Scanning Image 
The image is scanned starting from the origin at pixel location (0,0) and continues 


to be scanned from left to right, bottom to top as shown in Figure 13. 


2. Adjacency Test 


Once the pixel's gradient magnitude G(ij), gradient direction (ij), and 
significance have been determined, the pixel is then examined to be included in a region. 
The adjacency test evaluates the current pixel at location (i, j) and compares its gradient 
direction with each of four adjacent pixels to determine gradient direction closeness. The 
adjacent pixels are the pixel to the left (i-7, j), the pixel below (i, j-/) and its left (1-7,j- 7) 


and right (i+1, j-1) neighbors as shown in Figure 13. 


direction of image scan 


vertical axis of image (7) 





horizontal axis of image (1) 


Figure 14. Direction of scanning an image. 


3. Pixel Inclusion In a Region 

The pixel being evaluated is included in a region of existing pixels of adjacent 
neighbors that have close gradient directions and are significant. If the pixel does not meet 
the criteria to be included in a region, a new region is created with this pixel as the start of 
the new region. 

For any two pixels (7j) to be included in one region, R, the following conditions 
must exist: 


- Pixels (1j) and R must be adjacent. 
- The difference between the gradient direction (i) of pixel (5j) and the 


average gradient direction Dave of the region R is less than some specified angular 


difference 6 . 
If a pixel is adjacent to more than one significant pixels that are included in the same 
region, the new pixel will be included in that region if it meets the above conditions, 


otherwise it will be part of a new region. 


D. LINEAR FEATURE EXTRACTION 


Once the gradient image is constructed, we must provide a method for recognizing 
the sets of data points or pixels which form the linear feature of the region and a method 
for finding and describing the line segment that best fits these sets of data points. The 
method used for determining a line segment from the two-dimensional region of data points 
is by least squares fitting. In the gradient image, the moments of pixel locations (x, y pixel 
coordinates of the image) for all pixels in the region are computed to obtain the line 
segment for the regions's major axis. This line segment continues to grow until certain 
measures of the line segment indicate that the line segment should be ended and a new one 


started. We use an implementation of least squares fitting described by [KAN90]. 


]. Least Squares Fitting 
Suppose we have collected n consecutive valid data points in a local coordinate 
system, (p,,..., Pa), where p, = (x, y) for i 2 l,...,n. We obtain the moments mj of the set of 


points 


n 
m= S dyi; (0<j,k<2,andj+k<2) (Eq 6) 


i=l 


Notice that my, 2 n. The centroid C is given by 


NG ra) 
A RCA (Eq 7) 
E Moo -— 


The secondary moments around the centroid are given by 
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(Eq 10) 


We adopt the parametric representation (r,o) of a line with constants r and a. If a 
point p = (x,y) satisfies an equation 
r — xcosQ + ysina (-1/2«as€m/2) (Eq 11) 
then the point p 1s on a line L whose normal has an orientation & and whose distance from 
the origin 1s r as shown in Figure 14. This method has an advantage in expressing lines 
that are horizontal to the X axis. The point-slope method, where y = mx + b, is incapable of 


representing such a case (m = œ, b is undefined). 


p = (Xi, yi) 
— residual 







Figure 15. Representation of a line L using r and Q. 


The residual of point p, 2 (x, y) and the line L 2 (r, à) is. x;cosa * y;sina-r . 


Therefore, t the sum of the squares of all residuals is 


n 
S = ` (r— x;cosa — y;sino) " (Eq 12) 


ial 
The line which best fits the set of points is supposed to minimize S. Thus the 


optimum line (r,o) must satisfy 


dS dS 
L = — z= 0 Eq 13 
dr da a) 


Thus, 


n 
2 S V (r-x;cosa — y;sina) (Eq 14) 
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where r may be negative. Substituting r in Equation (12) by Equation (17) , 


S = y ((x;-[H,) cosa + (y;— Hy) sina) ? (Eq 18) 


p 
Finally, 
n 
3 = Z (Gt sina Dis mn (Eq 19) 


n n 


= 2 p? (s T" - Es i Y Jsinacosa 4 2 p» E — 4 (0: " (cos2a — sin? a) (Eq 20) 


iz] i=l 
- (Mg - M») sinZa * 2M,,cos2Q (Eq 21) 


=) 
Therefore 


atan (2M,,/(M,,-M.,,) ) 
mm 11 02 20 (Eq 22) 
2 
Equation (17) and Equation (22) are the solutions for the line parameters generated 


by a least squares fit. 


2. Finding Endpoints 
The residual of a point p; = (x, y,) is 
6, — (Uu, - xj) cosa 4 (1,3) sina (Eq 23) 
Therefore, the projection, p'. ofthe point p, onto the major axis of the distribution 
Ellipse is 
p'; = (x;+ ò cosa, y, + 6,sing) (Eq 24) 
We willuse p', and p', asestimates of the endpoints of the line segment L obtained 


from the set p of data points. 


3. Line Segment Validity Test Of Edge Region 
The equivalent ellipse of inertia in Figure 15 for the edge region, R, will have the 
same moments about the centroid (Mz, Mn, and Moz) as R. M major and M minors the moments 


about the major axes of the ellipse, are defined as: 


Mo», + M M,4,— (M44) Y 
MEME (Mo 02) _ ( 027 (M20 ) iM? (Eq 25) 
jor p > 11 


M,,+M Mo, = (Map) Y? 
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minor — 2 > (Eq 26) 
The lengths of the major and minor axes, d,,,,, and d,,,,, are: 
= q pea (Eq 27) 
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vertical axis of image 
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Figure 16. Equivalent ellipse of inertia. 


We consider the major axis to be the line segment L, for the edge region. The 
endpoint of the major axis will be the endpoints for the desired line segment. The 
projections of the first and last pixels, p’, and p’, associated with the region R, will therefore 
be used as estimates for the two endpoints of L. A ratio, p , of the axes length can then be 


used to describe the thinness of the ellipse. 


imor 
p = ———— (Eq 29) 
don 


Using the values for number of pixels (m), major axis length (d,,,,,,), and the ellipse 
thinness (P ) as parameters for comparison to edge region significance, edge length and 
how much the edge region resembles a line can be simply tested as long as the least squares 
fits moments are maintained for every pixel included in an edge region. Let C,( 0 S C, « 1) 
be a constant for the maximum allowable ratio p that can be used to describe a line. Let C, 
be a specified constant for the minimum number of pixels and C; for the minimum line 


length. Three requirements can therefore be specified for the line testing of an edge region. 
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I. The ratio of axes length is less than the maximum rho. (p « C4) , 
2. The number of pixels is greater than the specified minimum — (Mg 2 C4) , and 


3. The line length of the region is greater than the minimum length ( > Cs). 


d 

The ratio p proves to be the most significant measurement. For p to equal 1.0 
means that the length of the minor axis is equal to the length of the major axis, representing 
an edge region that resembles a circular blob. Therefore, p can be compared to a maximum 
ratio, C,, specified by the user. C; equal to 1.0 allows all edge regions to be considered thin 
enough to represent a line segment. A value of 0.1 seems to work well. 

The two other tests can be used to trim down the number of smaller, less significant 
line segments. The regions that meet these requirements will be saved for the desired output 


as the found line segments and all the other regions will be discarded. 


E. EDGE EXTRACTION RESULTS 


The edge region algorithm and the linear feature extraction described in the 
previous sections were implemented in the testedge algorithm detailed in Appendix A. The 
results of the input matrix images are shown in the following figures. Figure 16 shows the 
generation of edge regions from the square matrix image previously shown in Figure 4. 


Figure 17 is the line segment extraction of the square image in Figure 16. 
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Figure 18. Line segment extraction of edge region of square image. 


Figure 18 through Figure 23 show the matrix images and line segment results of 


more sample images. 
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Figure 19. Two light intensity values of 12 by 12 matrix sample image. 
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Figure 20. Line segment extraction of above image. 
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Figure 21. Three light intensity values of 12 by 12 matrix sample image. 
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Figure 22. Line segment extraction of above image. 
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Figure 23. Two light intensity values of 12 by 12 matrix sample image. 
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Figure 24, Line segment extraction of above image. 
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The edge region algorithm and the linear feature extraction described in the 
previous sections were implemented in the findedge algorithm detailed in Appendix B. The 
results of an actual input images shown in the following figures. The images shown in 
Figure 24 and 27 produces the gradient images shown in Figures 25 and 28 respectively. 

The extracted line segment features are shown in Figures 26 and 29. The five 
parameters for gradient threshold and line segment properties C, through C; were 


determined by trial and error to achieved the best line segment extraction. 
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Figure 27. Line segment extraction via findedge implementation. C, = 1.0, C, — 10 pixels, 


C; — 10.0. 
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Figure 30. Line segment extraction via findedge implementation. C, = 0.1, C, = 7 pixels, 


C;- 7.0. 
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The results of both line segment extractions can be refined by varying the 
parameters to find the best line segment output. However, this method is tedious and not 
ideal for implementation on board a robot operating in a dynamic environment. For this 
reason, we assume that the interior lighting level will remain relatively constant while the 
robot traverses its environment. An input image taken by the robot will be processed with 
a common set of edge region and linear feature parameters. These parameters could be 
established based on heuristics of various input images the robot would see in its 
environment. The parameters used for this test were varied slightly to improve the line 
segment extraction. The parameters were also left the same for all input images and the 
results were compared with the images in which the parameters were varied. However, no 
significant changes were Seen in the line segment extraction of the images. Examination of 
the line segment extraction results are consistent and enables further processing for pattern 
matching and pose determination [PET92]. 

Figures 30 through 32 demonstrate the ability of the findedge algorithm to 
discriminate details of an input image. This ability is ideal for object identification. 
Extracting enough information from an image could provide additional three-dimensional 


data to enhance the “intelligence” of the robots’s obstacle avoidance maneuvers. 
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Figure 31. Input image of a printer. 





15.0 degrees. 
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Figure 32. Gradient image of printer. C, 
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Figure 33. Line segment extraction via findedge implementation. C, 


e = 7.0. 
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An implementation of object identification on Yamabico is the alignment method 
[ULL91]. The basic premise of this approach is that given a known set of feature points for 
a known object and the same points on an unknown object, it is possible to map the two sets 
via constant coefficient linear equation if they are alike. The powerful aspect of this 
relationship is the fact that it is valid regardless of rotational/and or translational 
differences, permitting direct analysis of image objects according to the object database. 
[DEC93]. Once classifying an object, the ability to obtain object depth allows for obstacle 


avoidance measures based on image processing. 
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V. IMAGE TO SPARC BOARD INTERFACE 


A. SPARC BOARD DESCRIPTION 


Yamabico's IV-SPRC-25A CPU board has 16Mbytes of DRAM, located in the lower 
portion of the 4Gbyte address space. The address space above this 16Mbytes is devoted to 
VME bus use. It contains several memory regions as shown in Figure 33. The address space 
above these VMEbus regions is reserved for EPROM and board configuration 
registers.There are three logical mappings to the VME bus: the cluster-internal virtual bus, 
the synchronous Mbus and the asynchronous T-bus. All of Yamabico' s address space has 
been mapped using the T-bus. 

The VMEbus interface which resides on the T-bus allows operations with Motorola 
68020 type protocols. A T-bus master may only access other T-bus devices and local 
DRAM. T-bus features are: 

- Fully asynchronous bus 
- Separate 32-bit address and data buses 
- Four Gigabytes of physical memory address space 

The T-bus 32-bit address space is conceptually divided into seven regions. Some of 
these regions are fixed and others have programmable sizes. Figure 33 shows the default 
address space which was used in this system. The space is initialized by resident 
initialization code in the Ironics SPARC CPU card. There are two regions which involve 


the Yamabico’s image subsystem: Region 3 and A24 space [KIS95]. 
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Figure 34. VME mapping of image modules into SPARC-4 address space [KIS95]. 
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1. Region 1 Address Space 

Region 1 supports the same three addressing modes as region 3. It can deliver data 
as 16 or 32 bit blocks. The region starts at the end of local DRAM space and extends 
through the address specified in the Boundary 2 address register (Oxfffd0600). The 
attributes of this region are set in the Region | Attributes register (Oxfffd0900). The Ironics 


initialization code maps region 1 to the VMEbus as A32/D372. 


2. Region 2 Address Space 
Region 2 supports the same addressing/data modes as region 1 and 3. It starts at the 


end of region | extending up to the start of region 3. 


3. Region 3 Address Space 

Region 3 starts at the end of region 2 and extends to the bottom of the EPROM 
address space (Oxff000000). The attributes of this region are set in the Region 3 Attributes 
Register (OxfffdObOO). The Ironics initialization code initially sets up this region for 
addressing and data which contain 32 bits (A32/D32). To avoid conflicting with the address 
space used by the sonar, the image board can be offset from the base address of this region 
up to OxffOO in 0x100 intervals. The default offset, 0x0600, was chosen for Yamabico since 
it does not conflict with the VME address space for the sonar or the dual axis controller 
registers. The sonar registers are mapped to Oxfc008000 and the image board is mapped to 
Oxfc000600 and uses 64 words (0x00-0x7f). 

The image board addresses in this region are used to set initial configuration of the 
image board. This includes setting up address space for the actual images and additional 
modules such as the acquisition module and the display module. Configuration information 
stored in this region includes: 


Size mapped into VME memory space (image memory) 
Address space desired (24 bit of 32 bit) 

Input frame masking bits 

Page selection (image, acquisition module, display module 
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4. A24 Space 

The A24 space contains the actual images plus the acquisition module registers and 
display module registers. This region can overlay all three regions previously discussed. It 
can start anywhere from the top of local DRAM up to the bottom of EPROM address space. 
Yamabico's image subsystem uses the Ironics default for this region which is from 
0xfa000000 to Oxfbffffff. The default setting also assumes a 16 bit data width for the slave 


board. This default setting is also used, although data can be up to 32 bits wide. 


B. IMAGE BOARD DESCRIPTION 


1. Standard Image Manager (IMS) 

After setting up the A24 Space attributes some IMS configuration registers must be 
set to allow the acquisition module registers to map to this region [ITIIMS93]. These 
include the IMS configuration register, and page select registers. The IMS status register 
can also be checked to confirm that the IMS board is present. The configuration register 
contains bits that set the amount of memory to be mapped to VME address space and allow 
selection between standard (A24) or extended (A32) addressing. In the A32 mode, the high 
byte of the configuration register configures the upper 8-bits of the memory base address. 

As shown in Figure 33, the acquisition module is mapped to Oxfa000000, which is 
the beginning of A24 space. Standard addressing (24 bits) was selected with a map size of 
IMB. Module register access is not affected by this mapping size. With a map size of | 
Mbyte, the three images, the acquisition module registers and display module registers can 
be mapped to VME address space using the page register. The page register allows the 
setting of pixel size, choice of enabling or disabling VME memory access and the choice 
of selecting either one of three memory pages or the acquisition and display modules. 
Initially the page register is set to access the acquisition module registers through VME 


memory addresses. Figure 34 shows the flow of pixel data through the image manager. 
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Figure 35. Standard Image Manager (IMS) [ITIIMS93]. 





2. Acquisition and Display 

The IMS board is supported by two smaller plug-in modules: the Acquisition 
Module and the Display module. The Acquisition module provides an interface between 
the camera and the IMS board. The display module is described in the next section and 


interfaces with a display monitor. 
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a. Acquisition Module (AM) 


The acquisition module is produced by the same company as the main image 
board (Imaging Technology Inc.)[ITIAM93]. Itis designed to interface with many different 
cameras and operate in a variety of modes. This is both an advantage and a hinderance since 
the 17 registers augmenting the 43 registers on the main image board must all be 
programmed. The module itself can receive up to 24 bits in parallel, but the camera chosen 
is only an 8 bit grayscale. Our 8 bit version uses a RS-422 for data input. The camera's 8 
bit pixel data is first stored into a 4k by 8 bit FIFO queue and then transferred to the 
motherboard. In the 8 bit version of ITI's acquisition module the 8 bit camera data is passed 
directly to a 4K by 8 bit FIFO queue. The 8 bits are duplicated on three output channels. 
Since our camera is an area scan device, the acquisition module outputs horizontal and 
vertical frame timing to the mother board based on the line enable, frame enable and pixel 


clock inputs from the camera [KIS95]. 


b. Display Module (DM) 


The DM-PC Pseudocolor Display Module (DM) is a plug-module for the image 
manager. It provides a medium resolution pseudocolor RGB display for many types of 
monitors including 1024 by 768 non-interlaced and up to 1024 by 1024 interlaced 
monitors. It receives 8 bits of image data from the mother board (IMS module) and converts 
it into RGB pseudocolor. Overlay memory is supported for applications requiring graphics 
to overlay images. The heart of the display module is the Texas Instruments TMS34010 
Graphics System Processor (GSP) which controls all graphics and image display functions. 
All display module registers are in-turn mapped to the GSP registers. The pseudocolor 
transformation is performed by a Bt478 RAM digital-to-analog converter (RAMDAC). All 
options for displaying are software programmable. The route of data through these 


components is shown in Figure 35. 
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Figure 36. Display Module analog conversion block diagram [ITIDM92]. 


The display module displays an image that is stored in frame Bl of the IMS 
mother board. Therefore it does not do any processing on the image, other than the mapping 
that is done to display the image in a RGB format. The DM does support an overlay which 
can be programmed to display menus or text. This feature may be used in later research to 
display lines generated by edge finding software. 

The RAMDAC uses a look-up table (LUT) for the mapping of the 8 bit grayscale 


image on to a 24 bit RGB display image. There is also program memory available on the 


GSP which can be used to store operation code, such as the FIGA ™ graphical user 
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interface. There are three main hardware components for converting eight bit digital data 
into an analog video output: 

- Three Digital to Analog Converters (DAC) 

- DAC LUT (look-up table) 

- Overlay Color Table 

- Pixel Mask 

Figure 35 is a block diagram which shows the flow of data within the display 
module. The 8 bit image first passes through the pixel mask which allows the programmer 
to strip bits from each pixel. This could be used to limit the number of values used for each 
shade of gray and therefore, certain thresholds of differences between grayscales. For 
example, if only two values were required for further image processing, the pixel mask 
could be set to 1000 0000 binary. This would map the grayscale input to either 00 or 80 
hexadecimal and any pixel with a grayscale of 127 or less would be displayed as white and 
any pixel with a value greater than 127 would become gray. 

After exiting the pixel mask, the pixel data is transformed into a pseudocolor 
image with the DAC LUT. The DAC LUT consists of red, green and blue triplet bytes that 
contain the conversion value for each color. Because we want to see a grey scale 
representation of the image, we have coded the DAC LUT to echo the value of the pixel for 
all three colors. The DAC LUTSs could be used to accent a certain value, perhaps a threshold 
value of interest. In that case when a pixel with the threshold value was received, the green 
and blue DAC LUTs could output a 0x00 will the red outputs Oxff. This would cause all 
pixels with the value of interest to be displayed in red. 

The final processing that takes place prior to the image being displayed is 
combining an overlay with the image. The overlay memory consists of 1024x1024x4 bits 
of data. When the value of the 4 bits is zero, no overlay is displayed. The other 15 values 
can be obtained from the 4 bits and will override the image data with colors from a overlay 
color table. This table is accessed the same way the DAC LUT does with red, green and 
blue data obtained for each pixel [KIS95 ]. 
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VI. IMAGE UNDERSTANDING SYSTEM ON YAMABICO-11 


A. OVERALL FUNCTIONALITY 


The image understanding system on Yamabico-11] incorporates the real-time 
processing capabilities of the Single Board Super Computer System, SPARC™ CPU, and 
the image processing system of the Standard Image Manager (IMS) VME Board described 
in Chapter V. The recent installation of a COHU digital output camera coupled with the 
image board yields a higher system resolution and NTSC grayscale compatibility than the 
previous implementation of the JVC CCD camera described in Chapter II. 

The image understanding system is partly based on edge extraction and line fitting 
algorithms of [PET92] with a 3-D geometric model of the robot's world [STE92]. By using 
image grabbing routines of [KIS95], images are captured with the digital output camera 
installed on the robot. An image recording feature called the image log, similar to that of 
the motion and sonar log, was developed to store the captured image in the robot's memory 
for downloading to a workstation for further analysis. 

By porting image understanding routines previously developed for a Silicon 
Graphics Iris (SGI) workstation and modifying the routines for compatibility with 
Yamabico's image memory structure, the robot now has the ability to process images on- 


board. 


B. INITIALIZING IMAGE MANAGER 


The standard image manager’s initialization routine first sets the paging register to 
allow selection of frame memory, acquisition registers or display registers. The display 
initialization routine is called first. It is followed by the acquisition initialization routine. 
The frame masks are then cleared to allow 8 bits of pixel data to pass to each frame. Two 
control registers are then set. The first is for the image manager, which sets the clock 
frequency, along with enabling display and acquisition. More information on image 


initialization and routines can be found in [KIS95]. 


4] 


C. ACQUIRING IMAGE WITH SNAP COMMAND 


1. setInputPath 
This routine selects the camera input as the source of the image and puts the image 
in frames AO, A1, B1, where it will reside: 
- setinputPath(A0, CAMERA); 
- setinputPath(A1, CAMERA); 
- setInputPath(B 1, CAMERA); 


2. setFrameAcquire 
This routine sets up frames to receive a single image. The image operation is 
actually executed by the "acqEnable" command. 
- setFrameAcquire(A0, SNAP); 
- setFrameAcquire(Al, SNAP); 
- setFrameAcquire(B 1, SNAP); 


3. acqEnable 


This routine initiates the snap operation specified. Prior to this operation, frame B1 
is waiting and ready to receive the image. This command starts the acquisition. The 
command has no function call parameters: 

- acqEnable(); 
D. FORMATTING IMAGE FOR PROCESSING 


Combining the operations from the previous section, allows the formation of the 
primitives needed to format an image. The support routines used are described in [KIS95]. 
1. Log and snap an image in frame B1 for processing 
- setInputPath(B 1, CAMERA); 
- ImageLog(NULL, 0) 
- setFrameAcquire(B 1, SNAP) 
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- acqEnable(); 
- copyImageToMemory(B 1); 


The following code segment copies the image to memory as a two-dimensional 
array. This was needed for compatibility of the edge extraction and linear fitting 


algorithms. 


YAMAIMAGE blImage; 

void 

copyImageToMemory(IMSPage frameNumber) 
| 


unsigned long pagelIndex = 0xfa000000; /* First empty line for pg2 pixels */ 
unsigned long page2Index = Oxfa07a400; /* First 1K of pixels on page 2*/ 
unsigned long pagel Source = Oxfa000000; 

unsigned long page2Source = Oxfa07a400; 

int i,j; 

imi xSize = 132. 

int ySize = 476; 

blImage.xSize = xSize; 


blImage.ySize = ySize; 


for(120; 1«238; 1422) 
| 
for (j20; j«366; j422) /*732 bytes but 2 bytes per access */ 
{ 
blImage.image[i][j] = *(B YTE*)page1Source; 
page! Source += 2; 
bl Image.image[i+1][j] = *(B YTE*)page2Source; 


pagel Source += 2; 


page lIndex += 0x800; 
page2Index += 0x800; 


43 


page I Source = page I Index; 


page2Source = page2Index; 


LogImage(b1 Image); 


E. IMAGE UNDERSTANDING FOR MOTION PLANNING 


Sonar research [MAC93], [LOC94], has been the basis of motion planning for 
Yamatico-11 and has provided improvements in robot positioning accuracy. However, the 
integiation of an image understanding system enhances the overall sensor capabilities of 
Yamatico-11 and is the first step towards achieving complete and/or integrated visual 
navigation control. Various methods for implementation of a visual navigation system 
utilizing a single image have been pursued by [STE92], [PET92], and [DEC93]. Another 
approach of incorporating stereo vision for navigation 1s addressed by [KRI89]. 

One method is to store a model line segment image in the robot and match it with 
the actual line segment extraction data computed via the robot image processing system. 
By conducting pattern matching of both images, the capabilities for robot position 
correction, vehicular navigation, as well as object identification and recognition exists thus 
enhancing the visual navigation system. 

An example of a path generation [DEC93] problem can be used to execute the 
following algorithm: 

- Snap an image while traveling along a particular path. The robot sees the 
actual image in Figure 34. 

- Perform image analysis on the image. A model line segment image shown 
in Figure 35 has been downloaded into the robot and compared with the computed line 
segment extraction performed on the robot shown in Figure 36. 

- [f no object is detected, continue on the current path. Shown in Figure 36 


- If an object is detected, analyze object for range and dimension information. 
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- Determine the 'safest' and least significant maneuver and compute the 
required distance to shift left or right. 

- Define a new path based on the above input and transition to it or return to 
the original path once past the object, as detected by side-looking sonar. Shown in Figure 


By. 


Box object in 
hallway 





Figure 37. Hallway image with object. 
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Figure 38. Line segment model data structure. 


Figure 39. Model line segment extraction with box object. 





Environment with no object Environment with object 


Figure 40. Yamabico-11 image motion planning. 


These elements for path generation provide a richer sensing capability but may be 
limited due to physical hardware and software limitations of the robot. One software 
problem discovered by [KIS95] was the impact of the image system on the operation of 
other systems. The integration of the image understanding system into the motion control 
and sonar control could have resulted in several changes to MML but was avoided to permit 
development and testing of both images routines and MML separately. Other studies for 
combining vision with motion planning can be seen in [LUM88]. 

The capability of combining motion and sonar control by embedding image 
commands in the user.c routine and processing the image while the robot traverses its 
environment provides the framework for future image understanding needs for motion 


control. 
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VII. CONCLUSION 


A. OVERALL RESULTS 


The overall result of this research effort is an autonomous mobile robot that can 
now successfully capture and process an image on-board by finding straight edges in a 
grayscale (black and white) image. 

An image log was developed to record image data and provide downloading of the 
image from the robot to a workstation for further processing. By analyzing the image data, 
previously developed Silicon Graphics image understanding routines were able to be 
modified for compatibility with the robot’s memory structure. These routines were ported 
onto the robot's Single Board Super Computer System and provides Yamabico-11 with the 
on-board, real-time image processing capabilities. 

These features provide the foundation for future developments of a real time 


dynamic visual navigation system for an autonomous mobile robot. 


B. FOLLOW-ON WORK 


Although this research effort has improved the image processing capabilities of 
Yamabico-11, there remains much work to be done. The following are some possible areas 


of follow-on work. 


1. Sensor Integration 
The combination of sonar and vision capabilities can provide Yamabico with even 
greater information of its environment. Integrating the two sensors can improve the robot's 


obstacle detection, position determination, and object recognition abilities. 
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2. Image Processing Algorithm 


In order for Yamabico to be successful in a dynamic environment, the vision system 
must provide the robot with the ability to quickly assess its surroundings and navigate with 
safe and smooth motions. The governing principle behind Yamabico's ability to react is the 
algorithm used to compute the edge extraction. The method used in this work for scanning 
an image is cumbersome and increases processing time. Other methods such as arbitrarily 
picking a pixel location in an image based on random sampling is currently being pursued 
among the vision research group. This method appears logically to be more efficient and 


suitable for a robot operating in a dynamic environment. 


3. Embedding Image Understanding Software in MML 

Embedding image understanding routines in Yamabico's MML system can enhance 
the image understanding capabilities of the robot. Newly developed path planning software 
may allow the robot to operate independently for longer periods of time. An interrupt 
driven image understanding routine could continually look for obstacles independent of the 


other systems. 


4. Color Image Analysis 

Yamabico’s black and white camera was chosen to allow a grasslike computation 
of edge and line segment extraction routines which are more easier to compute than a 
colored image. However, the additional information in a colored image may increase the 
robot’s ability to recognize edges in an image. The detection of a change in the surface’s 


RGB value may allow the robot to find more significant edges. 
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APPENDIX A - TESTEDGE ROUTINES 


The following routines provide implementation for the edge region 
extraction and line segment extraction. Given an input matrix image the 
algorithm determines the edge regions for the gradient image and produces 
the line segment extraction.The files included are the following: 
types.h, linesupport.h, testedge.c. They are located in the -yamabico/ 
71ision95 directory. 


O ee 


/*file types.h 

ES 

/*This file holds the structure definitions for edge extraction and linear 
ritto routines. 

/*Types defined:EDGE REGION TYPE 


pe PIXEL INFO 
/* POINT_TYPE 
Le EINES Yer 


E EE RE A eae 


typedef struct edge_region_type 


Bur first pixel; 
int last pixel ; 
double avg phi; 
double sum phi; 
int reg num ; 
double m00 ; 
double mi10 ; 
double m01 ; 
double mii ; 
double m20 ; 
double m02; 
struct edge region type *next ; 
) REGION; 


typedef struct pixel info 
( 

double phi; 

REGION *r; 

Mt significant; 

ISPIXEL ; 


Struct point type 
( 


double x,y; /* x,y coordinates of the pixel endpoints */ 
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, 


typedef struct point type POINT; 
typedef struct match type 
( 


/* DINE *01ine:*/ /* ptr to LINE type (from Jim Stein's "graphics ere 
id 


double angle view diff; /* angular difference between image and model 
lines in the image */ 


float conf; /* confidence value for the match */ 
float dist; /* distance between the *match LINE and IMG LINE */ 
float scale; /* ratio IMG LINE-»dmajor / MODEL LINE-»length */ 


Struct match type *next; 


MATCHTYPE; 


typedef struct line type 
( 


char name[í3]; 
POINT pl p2; /* the 2 endpoints for the line */ 
struct line_type *next; /* ptr to the next IMG_LINE in the image */ 


/* Least Squares Fit momments: --------------------------------- x 
ine moo; /* Number of pixels */ 

double m10; VS Or x 57 

double m01; 7 oom SUT ye 

double mill; je oun x ye 

double m20; "Sum tx */ 

double m02; / "SIVE ES 

double phi; /* Calculated normal orientation of IMG LINE */ 


double dmajor; /* Length of major axis of equivallent ellipse */ 
double dminor; /* Length of minor axis of equivallent ellipse */ 


double rho; /* Ratio dminor/dmajor */ 
/* Pattern Matching Information: --------------------------------- QU 
double angle to image center; 
MATCHTYPE *matchlist; /* List of matches to LINE types */ 
MATCHTYPE *pm; /* present match being considered */ 
) IMG LINE; 
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[RRR RE AREA RRM RR RR RRR ee ee 


[*tile atanzee 
on 
/*This file provides a definition of the atan2() function. 


f * xx ek AR A Pe ED RE OD OS BE ED DE A a 


define PI 3.141592653589793 


double atan2(y,x) 
double x, y; 


if (x> 0.0) return arctan...) 
else if ((x < 0.0) && (y > 0.0)) return (arctan(y/x)+ PI); 
else if ((x < 0.0) && (y < 0.0)) return (arctan(y/x)- PI); 


else af ((% «90:0)&& (wcsz070)) return PE 
else if ((x == 0.0) && (y > 0.0)) return (PI/2.0); 
else if ((x == 0.0) && (y < 0.0)) return (-PI/2.0); 


else return (0.0); 


PA E ES EON DEOR UE ONGONOR NA EK RI A RRS RE OK ROR ee ey, 


/*FILENAME: linesupport.h 
/*AUTHOR: Leonard V. Remias and Khaled Morsy 
I DATE: 01 October 1995 


HN 

/*DESCRIPTION: Collection of region finding functions. 

M 

/*IMG LINE *create line (REGION *r, double M20, double M11, double M02, 
ns double Dmajor, double Dminor, double Rho) 

~ void fatal(char message) 


Nh void line test (REGION *r) 


UE ee he AR AK ARR RAR RR BORK KR A A ETE 


int xdim;/*width of input image (nr pixels) */ 
int ydim;/*width of input image (nr pixels) */ 


ime Lainecount = 0; /*counter for number of IMG LINEs made*/ 


IMG LINE *Line, list head - NULL; 


DS mE CER re i ee e ES de ear esee ei e S ee m E a mini ER TEST RES mg Um t e EE EE ER ERE EIE E EE E E KU 
/* void fatal (char message) 

j 

pe Prints error message and exits out of the program. 

pus ED A E AR A A eee A EE e EE Er O m t m x 


fatal (message) 
char *message; 


fprintf(stderr, "Fatal ERROR: "); 


perror (message); 
exit (-1); /* exit by failure */ 
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x 
= 
ZUR 
is 
des 
/ 
ee 


IMG LINE *create line (REGION *r, double M20, double M11, double M02, 
double Dmajor, double Dminor, double Rho) 


Returns pointer to newly instantiated IMG LINE with variables set 
according to moments described by REGION r, secondary moments 
M20, M11, and M02, axis lengths Dmajor, Dminor, and ratio of 

axis lengths Rho. 


IMC. LINE *create_line(r,M20,M11,M02,Dmajor,Dminor, Rho) 
REONON *r; 
double M20,M11,M02,Dmajor,Dminor,Rho; 


TMG-LINE 5$ 


Cono AZ ws 
double Phi, deltal, delta2; 
int negative_phi; 


JV -intt nentcter Creáte_ line"): »*/ 


/* r-»first pixel mapped onto the IMG LINE vill be endpoint pl 
r-»last pixel mapped onto the IMG LINE will be endpoint p2*/ 


x1 - r-»first pixel % (xdim), 

yl = r->first_pixel / (xdim), 
x2 = r->last_pixel % (xdim), 
y2 = r->last_pixel / (xdim); 


/* Calculate the normal orientation of the IMG LINE by atan2() 
Pune plone 


Phi - atan2(-2*M11,M02-M20)/2.0; 


/* Deltal and delta2 are the offsets used to calculate the endpoints 
for the IMG LINE segment based upon values x1,y1 and x2,y2.*/ 


deltal = (r->m10/r->m00 - (double)x1)*cos(Ph1) + 
(r->m01/r->m00 - (double)y1)*sin(Phi); 
delta2 = (r->m10/r->m00 - (double)x2)*cos(Phi) + 


(r-»m01/r-»m00 - (double)y2)*sin(Phi); 


/* Phi = atan2 (-2*M11,M02-M20)/2.0) always returns positive result to 


Phi. 
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p^ 


Therefore, negative phi - (r-»avg phi « 0.0) is necessary.*/ 


negative phi -» (r-»avg phi « 0.0); 


/* Allocate memory for IMG LINE 1.*/ 
if((l » (IMG LINE *)malloc(sizeof(IMG LINE))) == NULL) { 
fatal ("create line: mallocin"): 


/* Calculate x,y coordinates for endpoints pl and p2.*/ 


l-»pl.x - (double)x1 -« deltal*cos(Phi); 
l->pl.y = (double)yl + deltal*sin(Phi); 
l-»p2.x = (double)x2 + delta2*cos(Phi) ; 
1-»p2.y = (double)y2 + delta2*sin(Phi) ; 


/* Copy least squares fit moments.*/ 


imo — r-»m00; 
j cmi = r-»mi0; 
iS >m01L. = 1=>m01, 
Emil - r=>mll;, 
l->m20 = r->m20; 
1->m02 = r->m02; 


/* Phi is positive, but -pi « r-»avg ph1 « pi.*/ 


if(negative phi) l-»phi = -Phi; 
else l-»phi = Phi; 


/* Update rest of IMG LINE values.*/ 


l-»next = NULL; 
l-»dmajor = Dmajor; 
l-sdminor = Dminor; 


l-»rho = Rho; 

l->angle_to_image_center = 0.0; /* default values for LINE matching*/ 
l->matchlist = NULL; 

1->pm = NULL; 

++Linecount; /* Increment global variable, Linecount.*/ 
strcpy(l->name, " i 

sprintf(1-»name, "£d", Linecount); 

return(l); /* Return IMG LINE 1.*/ 


void write all lines (long x, 


—b—b——b————b——b————————b— ee eee — o — — — 


long y) 
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X 


PE Wratestosoutput file "li1nes.text". 
EIE D. e exco cu ee icu 
vrite all lines(x,y) 
long x,y; /* the x,y dimensions of the image 
( 


IMG. LINE *1 - Line.list. head; 
FILE *lines_file; 


lines_file = fopen("lines.text","w"); 


fprintf (lines_file,"--- DATA FOR EXTRACTED LINE SEGMENTS ---\n"); 

fprintf (lines_file, "Image size: nr pixels x axis = $d, nr pixels y axis 
E AN Y di 

fprintf(lines file,"Extracted line segments listed in order by 
Tena tn: Nana) 


printf("inenter write all linesin"); 


while (1!=NULL) 
( 


fprintf(lines_file,"%s> length = %.4f, thinness = %.4f, 
orientation = %.4f, m00 - $dWMn",l-»name, l-»dmajor, l-»rho,l-»phi, l- 
»m00); 

Eprintt (lanes tale, “endpoints: (.2f $.2t) (58.25.25) Non 
l->p1.x,l->p1.y,1l->p2.x, 1->p2.y); 


l = l->next; 
} 


fclose(lines. file); 


printf(" lines found in image written to: 'lines.text' Mn"); 
) 
"T 
x Es EE Ee e e ee e al a A ca te DES z 
/* void write all. lines (long x, long y) 
f= 
ie Write to output file "lines.text". 
if iss Oe e qe De PRE E 0 DES O AE O EPA ES E A SN TE ane Oe Pe eee AAA E EE Em x 
write all lines(x,y) 

long Xy; /* the x,y dimensions of the image */ 


IMG.LINE *1 - Line list head; 
FILE *lines. file; 
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lines file = fopen("Tlainmesctere iwi). 


while (1!'=NULL) 
( 
fprintfí(lanessfa We "S228 2.26 yee Ios. 25 Dn 
l-»plox,l-»5pl.y.1-5p2.x 1-»p2-»)* 


l = l-»next; 
} 


fclose(lines. file); 


printf(" lines found in image written to: 'lines.text' Mn"); 


) 


#include <stdio.h> 
#include <math.h> 
#include "types.h" 
#include "linesupport.h" 


#define MAX_DELTA_PHI deg_to_rad(15) 
#define PI 3714159265 


/* Constants for function: void line test (REGION *r) */ 

tdefine MIN PIXELS PER LINE 4 /*minimum pixels allowed for a IMG. LINE 
E 

define MIN. DMAJOR 4.0 /* minimum major axis length allowed */ 
tdefine MAX RHO 1.0 /* maximum ratio (Rho-Dminor/Dmajor) */ 


/*FILE *reg file;*/ 


IEEE! (1534) —- (150,150, 150, 150, 150,150; 150, 150. 150719580 150751507 
150 0505150, 150,150M0907 05071505 150 3:950. 1505] 5/05 
150, 15905090..19S0,15051507 1509750 10150 050: 150 se; 
150,15052150, Oi, OO OE OU OS OS USOS 


150,150, 150, —OQ,. O, OO OC S OS O ES OE 
150, ESO SO... C7 70, VO OC ec, OL O OA 
190.5050, 1350.7 (07 0, CU POD o O ESO SON 
150515071507. O. 0, 7:02 0, EO ES OSO ee 


150,750,150, 50, 10,7 07% 0. EO GENIS OL NIS DESDE 
1504,150,150;150,1950,150, 150,050 2S Uses 0 ES OE 
150/1590, 150, 150, 1507150, 1507050 P5 PS DOSE SOL 150. 
150,150,150,150,150, 150, 150, 1507/1506 ESO a0) 


Ee gip144]—- (150,150,150,1502150,150, “0 
TS OA OSO USO OSO O 

150-15071507 1507150; 150 S70 

T50 7r90 1500175079505 15099 05 

0 

0 


- 
~ 
~ 
~ 


- 


~ 


150 S07 1507 50,4 150, 
VSO" ES OS ESO lov O, 150, 


~ 


CO Dou 
CIS 
ZE E Se 
Soe E Ss = 


~ 
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00065: 0 150.150, 150: 150,150, 
MO 50150. 150:5:50. 1505 1502 
UAESO 50 150, 50 150.150» 
mU d o5 50 1505750 450. 
OD ES 000005 09 0 501150, 150, 1510, 
0, DUO, Un 01.050, 130, 150,150, 150,15 GE 


~ 
~ 
~ 


~ 


UEM Mc co 
EE coc o 
EN € co 
== SE 
EN oc o 


m 
~ 
~ 


are UA NC NS OC ES 0180: 1 901.150. 450 4507150: 1501 856 EE Or 
d'O 5 05 15071500 ES 055 04 SO S07 150 AsO: 
i507 130.150 o Oo DS O SOLO 
150/50 LOS A O 250550 150 O 
15071505150 SOLO USO D 
50/1507 1500 59 0/7, 45 QS Ou 04 
JS OE OS OS OS Om Or 
SIÓ, 1 SIORRES 0, 150, 70. 0 
d ger o0 Top" ED E 0, 
SO OO OO OS 
250 226050. qM EO 0 
0, 0, 0, 0, 0, 0, 0, O0, —0, 0, 0 TON 
acci ds: (150,150, 13507150, 150, 1507259) 20002 202 DO 
5305-1505. 1730, 150.150 LSO ZO LO 255 ZO ON 
POO, LOO my 1 EA A A BE 255 a BOE 
SO ES OS 01 50.0 50150, 255, 255102557 255725512 558 
SOS IT O SOL 5 001 50, 25592. 2550 255420 55, 2551 2550 
PS O20 LSO AO 5 07255, 255, 255, 255 2 52 O 
RE OS OS QS QS Or 0 0 72552255, 255 2 9 JET 


~ 


, 


- 


, 


~ 


~ 


f 


= 


-— 


4 


~ 


t 


0 
0 
0 
0 
0 
0, 
0 
0 
0 
0 


~ 


, 


~ 


4 4 


0 
0 
0 
, 0, 
0 
0 


~ 


, 


- 


~ 


é 


~ 


~ 


4 4 


~ 


Seles O OOO 
oo 5D CO © 2 a2 2 © CO O 


O OOOO 


f , 4 


~ 


, 


- 


ISO 5075055500 90.—.0. Da, :0,255,255,25592585 
iE507150715059 107790, O 70, ^0, —0,2555;255 55S 
E50- 150.20. <0, .0, 14077070, 70% 40 MO DS SL 
SOYA 0. 205 00. 2006 2025707 7305 — CON ARO Oo 
DO O AO OO OO OO OA 

double dx,dy,threshold = 90, 

double orientation, min; 

tong xdi- > 

long ydim=12; 

int neighbor_included; 

LIN € B 

int region found on the row; 

int neighbor included; 

inte c 

PIXED current[12]. prevfl12]; 

REGION *first region ; /* head of the linked list of regions */ 

REGION *last_region ; /* last region in the list so far */ 


REGION *reg; 
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f * kkockck hok ke RR RO RR KOEUKORCKGKOKUKUNCOK OE OK GENER CR UN KR KK KON Kok wok koe A LR 


FUNCTION |=: deg to rad() 
PURPOSE : convert degree to radian 


JE RE Re Re Pe KERR REAR ERE KEK REA EAR AE RRR ARR KR RR Re ee LI 


double deg_to_rad(theta) 
double theta; 
{ 

return theta * PI/180; 


EX a de ea ee BB DE OE dE dd E 


FUNCTION : normalize() 


PURPOSE : return the normalized value of orientation 
ED 2 Rak Sok eS eR ETE ERE ER AA A EE 


double normalize(o) 
double o; 
( 
mE d = 0; 
g—(o+Pi)/(2*P1); 


ie (a>=0) 

d=d+1 ; 
A O 2 FPI ~ aT ss 
return (o); 


ER RAR ARE RAR A AAA AR Be el ee O E E 


void update (current,x,y) 
PIXEL current[]: 

BDE x. Y; 

( 

REGION *reg; 

double o; 


s-current[x]ophrz; 
regscurrent([x].r; 
reg-»last pixel = 1; 
reg->sum_phi+=0; 
++reg->m00; 
reg->m10+=x; 
reg->m01+=y; 
reg->ml1l+=x*y; 
reg->m20+=x*x; 
reg->m02+=y*y; 
reg->avg_phi = reg->sum_phi / reg->m00; 
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/*fprintf(reg file,"XAn$d %d $d",x,y,req);*/ 


M ARM RE AEN WO REN A 


void comparel(current, x, y) 
PIXEL current [1] 
ToCA yV. 
( 
double t; 
REGION *current region; 
t= fabs(normalize(current[x] .phi-current [x-1] .phi)); 


if ((t«- MAX DELTA PHI )&&(current[x-1].significant -- 1)) 
( 
mins t; 
current[x]:r =~ cürrentix II r; 


neighbor_included = 1; 


Pe RNR NS ROH KORE Rr A A IE A A Ree ee ee ee ee 


void compare2 (current, prev, xl, x2, y) 

PIXEL current[], prev[]; 

e V: 

{ 
double t; 
REGION *current_region; 
t-fabs(normalize(current[x1].phi - prev[x2].ph1i)); 


af ((ct<= MAX DELTA PHI J)&&(prev[x2].significant == 1) 
( 
JP C enim) 
( 
min = t; 
current ixir = prev[xk2]-r; 
neighbor_included = 1; 
} 


à 


DE re ee Pe RE TR A A Be AE ee ee EE RE A RE a E 


REGION *create region(x,y,o) 
nb x 
double o; 


( 
REGION *reg; 


if((reg-(REGION *) malloc(sizeof (REGION) ))== NULL) 
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printf("create regioni); 


reg-»first pixel = 1; 
reg-»last pixel = i; 
reg-»avg phi - o0; 
reg-»sum phi - o; 


reg->m00 Ts 
reg->ml0 = x; 
reg->m01 = y; 
reg->mll = x*y; 
reg->m20 = x*x; 
reg->m02 = y*y; 
reg->next = NULL; 


TPf(first region -- NULL) 
first region - reg; 
Bfilast region !SNUBEE) 


last, region-»next-reg; 
last region-reg; 


return(reg); 


} 


Da Re ee de Re de de PEA AE EE DE RR ORK Re ee 


void pixel membership(current, prev, x, y, o) 
PIXEL current[l, prev[]: 

Ent x, y; 

double o; 


( 
REGION *reg; 


if (x >I) 
{ 
comparel (current, x, y); 
qu S yr cs IB) 
compare2 (current, prev, x, x-1, y); 


) 
at) 
( 
compare2(current, prev, x, x, y); 
compare2 (current, prev, xX, X+1, y); 


) 
if (neighbor included==0) 
{ 


reg = create region(x,y,o); 


/* fprintt (reg_file,"\ntd %d %d", x, y, reg);*/ 
current [=== rea: 


if (neighbor_included ==1) 
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update(current,x,.v); 


LE ES ES a CA RS SS RES m e im cem me emm em m m em eem A ee A A ee ea x 
/* void line test (REGION *r) 
DR 
"Es Determines if REGION r meets three requirements to be a IMG LINE: 
jan (1) The number of pixels in REGION r (r->m00) be greater than 
s MIN PIXELS PER LINE. 
ES (2) The ratio (Rho) of the length of major and minor axes of the 
fe REGION be less than MAX RHO. 
PR (3) The length of the major axis (Dmajor) be greater than 
do MIN DMAJOR, the minimum IMG LINE length alloved. 
ha If all three conditions are met, a new IMG LINE type is created and 
je appended to the Line list in order of significance (in this case 
x Dmajor). 
fos CINE aa as ae VE at a Na ca ee a PM ue WR I VICE SCC PC Cr A 
line test (r) 

REGION *r; 
( 

IMG LINE *1, *insert. pt - Line list. head; 

double M20,M11,M02; 

double Ma,Mb,Mmajor,Mminor,Dmajor,Dminor,Rho; 

/* First test -- A IMG LINE must have a required minimun number of 


pixels.*/ 


if(r->m00 » MIN PIXELS, PER LINE) 


( 


/* Calculate secondary moments by least squares fit.*/ 


M20 
M11 
M02 


r->m20 - ((r->m10*r->m10)/r->m00); 
r->m11 - ((r->m10*r->m01)/r->m00); 
r->m02 - ((r->m01*r->m01)/r->m00); 


/* Calculate major and minor axis lengths, Dmajor and Dminor.*/ 


Ma = 
Mb = 


(M20+M02)/2.0; 
sartí ((M02-M20)*(M02-M20)/4.0) + (M11*M11) ); 


Mmajor - Ma - Mb; 
Mminor - Ma + Mb; 
Dmajor - 4.0*sqrt(Mminor/r-»m00); 
Dmunor = 4.0*sart(Mmajor/r->m00); 


/* Calculate ratio Rho.*/ 


Rho 


= Dminor/Dmajor:; 


/* Second & Third tests 
-- Ratio Rho must represent a line, not a blob. 
-- IMG LINE must be at least a certain length.*/ 
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if((Rho « MAX RHO) && (Dmajor » MIN DMAJOR)) 
( 
/* The REGION passed the three requirments to be a line.*/ 


l = create line(r,M20,M11,M02,Dmajor,Dminor,Rho); 


/* Add new IMG LINE to IMG LINE list in order by IMG LINE 
Mength, dmajor.*/ 
if (Line list head -- NULL) 
( 
Line-listobead - 1; 


) 
else if (l-»dmajor » Line list, head-»dmajor) 
( 
l-»next - Line list. head; 
Line. list. head - 1; 
) 
else 
( 
while((insert pt-»next != NULL) && 
(l-»dmajor « insert pt-»next-»dmajor)) 
( 
insert pt - insert pt-»next; 
) 
l-»next - insert. pt-»next; 
insert pt-»next - 1; 


)o7* end if second anedmthnird tests: / 
) 7* end if- first test '/ 


HELL v toa EROR Koo mx Xx KE KE A A A E M 


main function */ 
EMEND USER DE BO A A 


main () 
( 
PIXELocurrent[l2]5,9prevbrt2]-5 
ane UL, U -UR -LR DL? DDR, C, 
/* reg file - fopen("regions.txt","w");*/ 


for (y=1; y < ydim ; ++y) 
( 


for (x=1:;: x < xdim ; Trx) 
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eae Se xdim) + X; 
neighbor_included =0; 
min = PI; 


UL=i+xdim-1; U = UL+1 ; UR = U+l:; 
L= 1-1 >; R = 1-415 
DL=i-xdim 1 ; D-DL+1; DR = D+1:; 


1 cds) 
( 
for (c0: cexdim-1-7 C++) 
( 
prev[c]2current[c]: 
current [c] phi=0.0; 
current[c].r = NULL; 
current [c]"sioniticant = 0; 


if((x !- xdim-1) és (y !- ydim-1)) 


/* calculate dx,dy via sobel operator for pixel i */ 
dx = -gl(UL] - g1l(UR) 

-2*gl[L] + 2*g1[R] 

-gl[DL] + gl[DR]; 


dy - gl[UL]-*2*g1[U]-*gl[UR] 
EPIS SD aun" 


if((dx*dx)+(dy*dy) > threshold) 
( 
orientation - atan2(dy,dx); 
current[x].phi = orientation; 
cürrent[x].significant = 1; 
pixel membership (current,prev,x,y,orientation); 


/* felose(reg file) */ 


/* Check remaining REGIONs for lines: */ 


reg = first region; 
while(reg !- NULL) 
( 
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line testí(reg): 
reg - reg-»next; 
) 


/* Write the dames list toe et times . text ae, 


write all lines(xdim, ydim) ; 
printf("\nLines found in image written to:'lines.text'\n"); 
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APPENDIX B - FINDEDGE ROUTINES 


JE RE RE RR Re RE RE EFE EX RR EP PAE P TD AA A A a a E E T EET ETS REE EE 


ye FILENAME: findedge.c 
n AUTHOR: Leonard V. Remias and Khaled Morsy 
some fragments from Peterson 

y= DATE: 18 January 1996 


Dot 


fr 


/*DESCRIPTION: An image gradient program incorporating edge-finding. 
/*Displays edge-gradient image and associated lines. 


n5 


/*This application is designed for use on a Silicon-/*Graphics Iris 


/*workstation utilizing a.sgi or similar rgb formatted image. 


/*RGB values are of 


od 
"t 
Dt 
7 d 
/ * 


type LONG in the form AABBGGRR where: 


AA - alpha value, 0-255 

BB - blue component, 0-255 
GG - green component, 0-255 
RR - red component, 0-255 


/*SiliconGraphics graphics library functions used within the 
/* display bw and gradient images() routine: 
qdevice(), winset(), c3f(), move2(), draw2(), 


ie 
a 
AZ 
er 


swapbuffers(), 


reshapeviewport(), winclose(), 


and lrectwrite(). 


/*NPSIMAGE function routines borrowed courtesy of M.Zyda: 


/*read_sgi_rgbimage(), 


/*get_empty_rgb_npsimage(), and 


yo 


get empty rgba, npsimage(), 


rgbalong to bwlong(). 


/*Least Squares Fit method for line-finding from 
/*"Sonar Data Interpretaion for Autonomous Mobile Robots" 


/*by Y.Kanayama, T.Noguchi, & B. 


Hartman, 1990. 


(on) 


EE re mop A E 


#include 
#include 
#include 


#include 
#include 


#include 
#include 
#include 
#include 
#include 


cns /* SiliconGraphics (r) graphic library 
<gl/image.h> /* SGI image structure library 
<device.h> /* Machine-dependent device library 

/* for keys and mouse-buttons 
<stdio.h> /* C standard i/o library 
«math.h» /* C math library for atan2() 
"image types.h" /* Type definitions for NPSIMAGE, etc. 
"edge types.h" /* Type definitions for EDGE, LINE, etc 
"npsimagesupport.h" /* Some NPSIMAGE functions 
"edgesupport.h" /* EDGE and IMG LINE building functions 
"displaysupport.h" /* Graphics display functions 
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int neighbor. included; 


main(argc, argv) 
int argc; 
char *argvl]:; 


NPSIMAGE *imgl, /* input file name.rgb color image */ 
*img2, /* black&white image */ 


*img3; /* gradient image */ 


/* pointers to RGBA longs ("bitsptr"s) of respective NPSIMAGEs */ 


long “perl. *pbrEe2 A PCI) 
double dx, dy, Th = THRESHOLD* THRESHOLD; 
int z = 0; /*counter for pixels in gradient image */ 


REGION ‘reg; 

PIXEL current[646],prev[646]; 
douole orientation; 

Iae ULU UR; L R, DL D DR, C: 

Tbe 

long X, Y; 

Tong ptr4l:?13956]7  /*646 x 486 t 


reg file - fopen("regions.txt","w"); 
if(argc !- 2) fatal("usage: findedge filename\n") ; 


/* Read in input rgb image */ 
imgl - read sgi rgbimage(argv[1]); 
if(imgi ==(NPSIMAGE *) NULL) 

( 

fatal("File $s is a NULL image.Mn",imgl-»name); 

) 
Xdim = imgl->xsize; /* else set global Xdim and ptrl1 */ 
Ydim = imgl->ysize ; 


ptr! - imgl-»imgdata.bitsptr; 
/* printf("findedge:» $s xsize- $d ysize= %d pixels= %d\n", 
imgl-oname,imgl-oxsize,imgl-oysize, (imgl->xsize*imgl- 
>ysize));*/ 


/* Declare new NPSIMAGEs */ 
if((imgl->type -- RGBAWITHALPHA) || (imgl->type == RGBA)) 
{ 
img2 = get_empty_rgba_npsimage(Xdim, imgl->ysize,imgl->name) ; 
img3 - get empty rgba npsimage((Xdim-2),imgl-»ysize-2,"findedge"); 
) 
else 
( 
fatal ("Unknown or c-mapped image type: %d.in",imgl->type); 


) 
ptr2 = img2->imgdata.bitsptr; 
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ptr3 = 1m93-=>1mgdata. brespr 


/* The scan of an RGB image is from the bottom row -» up, 
traversing the rows left to right. */ 


/* In order for the Sobel operator to be calculated for a specific pixel, 
all eight surronding pixels must have an absolute (black & white) 
light intensity calculated. Function rgbalong to bwlong() performs 


this task. 77 


/* Due to the nature of the Sobel operator, the pixels in the top and 
bottom rows as well as pixels in the leftmost and rightmost columns 
of the input image will not be calculated. In order to start cal- 
culating the Sobel operators, the first 2 rows of the input image 

must be converted to black & white light intensity values. */ 


/* Calculate bw values for the entire input image. */ 


reor(1=0; i< ((Xaim * Ydim)=1):++1) 
( 
rygbalong to bwlong( perilil-&ptr2 IiI); 
ptrá[i] = grax 


for (y=0; y < Ydim; ++y) 
( 
for (x20; x « Xdim; ++x) 


( 


i = (y | Xdim}) x; 
neighbor_included = 0; 
min PI 


UL=1+(Xdim-1); U = UL+1 ; UR = U+l; 
L= 1-1 ; R = itl; 
DL=1-(Xdim-1); D=DL+1; DR = D+1; 


3px == (xarme Ll) 
( 
Lore cc) ccu xdim-i)- c) 
( 
prev[c)]2current[c]:; 
CUrrenclel ens - 0. 0L 
currenbElcelr = NULL: 
eurrent[¢c). significant = 0; 


if((y == 0) || (y == (ydim-1)) T e CO O) 


{ 
set_pixel_black(&ptr3[i}]); 
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else 


( 


i calculate dx dy via Sobel, operator for pixel i. */ 


dx = - (ptr4[i+(Xdim-1)]) + (ptr4[i+(Xdim+1)]) 
= 2 *( ptr4[i-1])+ 25*(ptr4[i+1i]) 
- (ptr4[i-Xdim-1]) + (ptr4[i-Xdim+1]); 
dy = (ptr4[i+Xdim-1]) + 2*(ptr4[i+Xdim]) 
+ (ptr4[i+Xdim+1]) -(ptr4[i-Xdim-1]) 
- 2*(ptr4[i-Xdim]) - (ptr4[i-Xdim+1]); 


DE cdseseber e (dy *dy) = TH) 
( 
orientation = atan2(dy,dx); 
current (xi. phau-Norrentati on, 
cürrent[x] significant = I; 
pixel membership(current,prev,x,y,orientation); 
set pixel black(&ptr3[z]); 


else 
set pixel white(&ptr3([z]); 


++z; 


) 
A endi or iK ty 
A tend fory A 


fclose(reg file); 
reg - first region; 
while (reg != NULL) 
reg->m10,reg->m01, reg->m11, reg->m20, reg->m02) ; */ 


line_test (reg); 
reg = reg->next; 


/* Write the lines list to file "lines.text". */ 
write_all_lines(argv[1],img3->xsize,img3->ysize); 
printf("\nNumber lines found in $s - $d", argv[1],Linecount); 
printf("MnNumber regions found in $s - $dWMn", argv[1],reg count); 


/* Display the black&white and gradient images on the screen. */ 
display bw and gradient imagesí(img2,img3,Line list head); 


display line image(img2,Line list head); 


printf("infindedge %s...done.in",argv[1]); 
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RE RE RR RR EE RP Re Re RE DE P PE RE RA DE IE ED Kk Occ ok ek ck KR Xe ELLE 
/*file edge types.h 

VR 

/*This file holds the structure definitions for edge extraction and linear 
FEitting routiHess 

/*Types defined:EDGE REGION TYPE 


a PIXELSENBO 
1" POINT TYPE 
Ji LINE TYPE 


Da RE IR De BR De BE Es DE de EE DE EO CE DR BO ee EE RE ED DE OD eee ee, 


Struct point. type 
( 


double x,y; /* x,y coordinates of the pixel endpoints */ 
js 
typedef struct point type POINT; 


typedef struct line type 
( 
char name[3]; /* for troubleshooting */ 


POINT pl, p2; /* the 2 endpoints for the line */ 


/* Least Squares Fit momments: */ 


double m00; /* Number of pixels should be long*/ 

double m10; 7* Sum x. *5 

double m01; /= Siam yY */ 

double mil; ¡"SU Y = 7 

double m20; /* Sum AX t 

double m02; UNa y 7 

double phi; /* Calculated normal orientation of IMG_LINE */ 


double dmajor; /* Length of major axis of equivallent ellipse */ 
double dminor; /* Length of minor axis of equivallent ellipse */ 


double rho; /* Ratio dminor/dmajor */ 
Ger attern Matching intormation: = -m a a v 
double angle_to_image_center; 
int *matchlist;/* Bogus pointers for IMG_LINE *create_line(EDGE *r,...) 
Ly 
/* in 'edgesupport.c'. */ 
Ent *pm; /* These pointers are required for matching and are 
declared as (MATCHTYPE *)s in 'match types.h' 
7 


struct line type *next; /* ptr to the next IMG LINE in the image */ 


) IMG LINE; 


7] 


typedef struct edge region type 


( 


) 


long 

Long 

double 
double 
double 
double 
double 
double 
double 
double 
SUE E 
REGION; 


first_pixel; 
last_pixel ; 
avg_phi; 
sum_phi; 

mOO ; 

mio : 

mol. 

Mel: 

m20; 

In); 

edge region type *next ; 


typedef struct pixel info 


( 


double phi; 


REGION 


int significant: 


) PIXEL 


. 
, 


A AEREA De ee E 


FILENAME: edgesupport.h 
AUTHOR: Leonard V. Remias and Khaled Morsy 


ya 
ys 
JE 
pe 
x 


DATE 


(some parts from original version by Peterson) 
: 19 January 1996 
with new changes 


/*DESCRIPTION: Collection of edge finding functions. 


jd se 
UO 
ES 
Je 
PN 
J 
Ja 
Vm 
Dm 
PN 
j 
PN 
zh 
ZA 
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fatal(char message) 


int gradient angles close(double r,double s) 


Ine 


close_to_negative_pi(double phi) 


int horizontal(EDGE *r) 
REGION *create_region(int x, int y, double o) 


void 
EDGE 


add pixel to edge (long z, double phi, EDGE *r) 
*combine edges(EDGE *rl1, EDGE *r2) 


IMG LINE *create line (REGION *r, double M20, double M11, double M02, 


Void 
void 
void 
void 
void 
void 
void 


IMG. 


double Dmajor, double Dminor, double Rho) 

line test (REGION *r) 

check active edges () 

rgbalong to bwlong (long rgbalong, long *bwlong) 

pixel membership (long z, double phi) 

set pixel white (long *rgbalong) 

set pixel black (long *rgbalong) 

write all lines (long x, long y) 
LINE *fastlines (NPSIMAGE *img) 


VIE CEUR HRN, NK Cena TIA EN ER ERA AER AR ERRE RARA RR AR NA 


T2 


#define THRESHOLD 70.0 


/* Gradient Angular Orientation */ 
/*#d@efine MAX DELTA PHI deg to rad(15) */ 
tdefine MAX DELTA, PHI (PI*15/180) 

#define PI Bor 50265 


/* Constants for function: void line _ test (REGION *r) */ 


#define MIN_PIXELS_PER_LINE 7 /* was 10 minimum pixels allowed for a 
IMG LINE */ 


#define MIN_DMAJOR 7.0 /*was 10.0 * minimum major axis length 
allowed */ 

#define MAX _RHO O /* maximum ratio (Rho=Dminor/Dmajor) */ 
/* --- Global variables ------------------------------------------------ 
E 

FILE *reg file; 

lug Xdim; /* width of input image (nr pixels) */ 

long  Ydim; /* width of input image (nr pixels */ 

muto Linecount = 0: /* counter for number of IMG LINEs made "/ 
Bot reg count = 0; /* counter for number of regions */ 

Prnt gray ; /* added by khaled 1-8-95 */ 


/* Pointers to: first region , last region and IMG LINE list*/ 


REGION "first region-NULL: 
REGION *last_region=NULL; 
IMG_LINE *Line list head = NULL; 


int neighbor included; 
double min; 


EE t EUREN UK A O I cc: 


FUNCTION : deg to rad() 
PURPOSE : convert degree to radian 


AA AAA ERE REA ERE ARE AAA AAA AAA AREA AAA a a 


double deg_to_rad(theta) 
double theta; 


( 
return theta * PI/180; 


LLL eccl TERR Kok ook ok de EE eo ok ok ok ok ok oe oko e ko koh ehh kk FE Fe 


FUNCTION : normalize() 
PURPOSE : return the normalized value of orientation 
zu ene ee ARS AR AAR ERE EAE ER RRA KW RRR RRS KARA A 
double normalize(o) 
double o; 
[ double h=0; 
int d = 0; 
if(o»--PI && o «PI) return(o); 


dd (OPE MMS Dr) |; 

if (d>=0 && o > 0.0) 
d=d+1 ; 

oc O la =P (d-1)).: 


/* while(o « -PI) 
o = o + PI + PI; 
while(o >= PI) 
o = o-PI-PI;*/ 


return (o); 


void update(current,x,y) 
PIXEL current[]; 

long xX, y: 

{ 

REGION *reg; 

double o; 


ocurren pana 
reg=currentÍ[x].r; 
reg->last_pixel = (Xdim * y + x); 
reg->sum_phi+=0; 

++reg->m00; 

reg->m10 += x; 

reg->m01 += y; 

reg->m11 += x*y; 

reg->m20 += x*x; 

reg->m02 += y*y; 

reg->avg_phi = (reg->sum_phi / reg-»m00); 
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TER EE RE RE RR RR Re RX RR XD PE DE EE EA AN x CS Ru I|: : 21222. 
void comparel(current,x,y) 
PIXEL current([]; 
Long xv. 
( 
double t; 
REGION *current region; 
t- fabs(normalize(current[x].phi-current([x-1].phi)); 


if ((t«» MAX DELTA, PHI )&&(current[x-1].significant -- 1)) 
( 
Min ct: 
Current (xX)er = current (x= ler, 
/*current[x].region number - current[x-1].region number ;*/ 


neighbor included = 1; 


) 


DR EA Re ee OE De Re de BOE EE A E Rok e KE E A MELLE 
void compare2(current,prev,x1,x2,y) 

PIXEL current[],prev[]; 

eng x1l,x2,Y; 


{ 
double t; 
REGION *current_region; 
t-fabs(normalize(current[x1].phi - prev[x2].phi)); 

if ((t<= MAX DELTA PHI )&&(prev[x2].significant -- 1)) 


( 


if (t«min) 


( 
ID NN 
Current |x] ] 5 = prey [<2 ea; 
/*current[xl].region number = prev[x2].region_number ;*/ 


neighbor_included = 1; 
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ZEZLIEL Ln LU OU OSEE NOR Kx kk kokok ke kok kk ok kk e ke koe Sk ko kk kk ke ok ke 


REGION *create region(í(x, y, o) 


long x y: 
double o; 


{ 
REGION *reg; 


if((reg-(REGION *) malloc(sizeof (REGION) ) )==NULL) 

{ 

printf ("create edge"); 

) 

*-reg count; 
reég->first_pixel =(Xdim * y +.x)]); if( reg -first pixel $0) 

printf ("ERROR"); 

reg->last_pixel = (Xdim * y + x); 


reg->avg_phi = o; 
reg->sum_phi = o; 
reg->m00 = 1.0; 
reg-»ml10 = x; 
reg->m01 = y; 
reg->mll = x*y; 
reg->m20 = x*x; 


reg->m92 = y*y; 
reg->next = NULL; 


erst region == NULL) 
First regaon = reg; 

Lf (last_region != NULL) 
last_region->next = reg; 


last region-reg; 


returní(reg), 


) 


A O E E A RA de 


void pixel membership(current,prev,x,y,o) 
PIXEL currentí(),preví): 


long X,Y: 
double o; 


( 
REGION *reg; 


A cs lA) 
( 


comparel(current,x,y); 
JEMEN 
( 
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compare2(current,prev,x,x-1,y); 


) 

if (y > 1) 

( 

compare2 (current pbevex x wy 
compare2(current,prev,x,x-*l,y); 


if (neighbor included -- 0) 
( 
reg - create region(x,y,o); 
fprint£(reg_file,"\ntd %d %u", x, y, reg); 
current[x].r = reg; 
) 
if (neighbor. included -- 1) 


( 


update (current. x,y); 


a SS SS a Se pt a SS Se ee 
/* void fatal (char message) 

yt 

n Prints error message and exits out of the program. 
p eee ee Er a s ee em erm e eee ee me me em meme eme eem emm leer mee me em eee eem em imei em mm eee ee mee oe m erm SES 


fatal (message) 
char *message; 


fprintf(stderr, "Fatal ERROR: "); 
perror (message) ; 
exit(-1); /* exit by failure */ 


/* IMG_LINE *create line (REGION *r, double M20, double M11, double M02, 


LT double Dmajor, double Dminor, double Rho) 

dS 

ee Returns pointer to newly instantiated IMG_LINE with variables set 
A according to moments described by REGION r, secondary moments 


p M20, M11, and M02, axis lengths Dmajor, Dminor, and ratio of 


F axis lengths Rho. 

IMG LINE *create line(r,M20,M11,M02,Dmajor,Dminor,Rho) 
REGION *r; 
double M20,M11,M02,Dmajor,Dminor, Rho; 


IMG_LINE dl 
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lines UI x22: 
double Phi, deltal,  delta2; 
int negative phi; 


/* r-»first pixel mapped onto the IMG LINE will be endpoint pl 
r-»last pixel mapped onto the IMG LINE will be endpoint p2 */ 


xl = r->first_pixel%(Xdim), 
yl = r-Sfirst pixel / (Adam), 
x2 = r->last_pixel%(Xdim), 
y2 = r->last_pixel/(Xdim) ; 


/* Calculate the normal orientation of the IMG_LINE by atan2() function. 
eri 


Phi = atan2(-2*M11,M02-M20)/2.0; 


/* Deltal and delta2 are the offsets used to calculate the endpoints 
for the IMG LINE segment based upon values x1l,yl and x2,y2. */ 


deltal = (r->m10/r->m00 - (double)x1)*fcos(Phi) + 
(r->m01/r->m00 - (double)y1)*fsin(Phi); 

delta2 = (r->m10/r->m00 - (double)x2)*fcos(Phi) + 
(r->m01/r->m00 - (double)y2)*fsin(Phi); 


/* Phi = atan2(-2*M11,M02-M20)/2.0) always returns positive result to 
Phi. 
Therefore, negative phi » (r-»avg phi < 0.0) is necessary. */ 


negative phi -» (r-»avg phi « 0.0); 
/* Allocate memory for IMG LINE 1. */ 
if 0( 1) (IME LINE *)malloc(srzeof(IMG DLINE))) == NULL) { 
fatal("create line: mallocin”); 


) 


/* Calculate x,y coordinates for endpoints pl and p2. */ 
l->p1.x = (double)x1 + deltal*fcos(Phi); 


l-»pl.y = (double)yl + deltal*fsin(Phi); 
1->p2.x = (double)x2 + delta2*fcos (Phi); 
l->p2.y — (double)vy2 + delta2*fsin(Phi); 


/* Copy least squares fit moments. */ 
l->m00 = om Or 
1->m10 = r->ml0; 
1->m01 = r->m01; 
1->m11 = r->mll; 
1->m20 = r->m20; 
l-»m02 - r-»m02; 
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/* Phi is positive, but Pie = ayva Phi cpu 


if(negative_phi) l->phi = -Phi; 
else l->phi = Phi; 


/* Update rest of IMG_LINE values. */ 


1->next = NULL; 
l-»dmajor = Dmajor; 
l->dminor = Dminor; 
1->rho = Rho; 


l->angle_to_image_center = 0.0; /* default values for LINE matching */ 
l-»matchlist = NULL; 


1-»pm - NULL; 
++Linecount; /* Increment global variable, Linecount. */ 
strcpy(l-»name," O 
sprintf(l-»name, "$d", Linecount); 
return(1); /* Return IMG_LINE 1I: S 
) 
yu ee ide mme mi e dus ms M A O es eee a een me a ee a ee a A E EE ad ee EE ED 
/* void line test (REGION *r) 
ut 
pt Determines if REGION r meets three requirements to be an IMG LINE: 
px (1) The number of pixels in REGION r (r->m00) be greater than 
Js MIN_PIXELS_PER_LINE. 
pus (2) The ratio (Rho) of the length of major and minor axes of the 
y^ EDGE be less than MAX RHO. 
po^ (3) The length of the major axis (Dmajor) be greater than 
ye MIN DMAJOR, the minimum IMG LINE length allowed. 
s If all three conditions are met, a new IMG LINE type is created and 
Jut appended to the Line list in order of significance (in this case 
¿e Dmajor). 
nm mA rtr m TEE ene due. mew qu Lee ESP I Ee Eee E eR Ee me ae a ee e EE ERE E E RR RE. dum mum mus MES EN E EE EE E 
line. test(r) 
REGION *r; 
( 


IMG LINE Ll *imsertept = bane listaneaa, 
double M20,M11,M02; 
double Ma,Mb,Mmajor,Mminor,Dmajor,Dminor, Rho; 


DAR Re RE Pe RE EE ee ele es EE OO ee ee ee 


/* First test -- A IMG LINE must have a required minimun number of pixels. 
= / 


U SRR RAK RAS RR El ee OO BE AO II eee ae) 


1f(r->m00 > MIN PIXELS PER LINE) 
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/* Calculate secondary moments by least squares fit.*/ 


M20 = r->m20 - ((r->m10*r->m10)/r->m00); 
M11 = r->m11 - ((r->m10*r->m01)/r->m00); 
MO2 - r-»m02 - ((r-»mOl*r-»m01)/r-»m00); 


/* Calculate major and minor axis lengths, Dmajor and Dminor.*/ 
Ma = (M20+M02)/2.0; 

Mb - sqrt( ((MO2-M20)*(MO2-M20)/4.0) + (M11*M11) ); 

Mmajor = Ma - Mb; 

Mminor = Ma + Mb; 

Dmajor = 4.0*sqrt (Mminor/r->m00) ; 

Dminor = 4.0*sqrt (Mmajor/r->m00) ; 


/* Calculate ratio Rho.*/ 
Rho = Dminor/Dmajor; 


/* Second & Third tests -- Ratio Rho must represent a line, not a blob. 
-- IMG, LINE must be at least a certain length. */ 


if((Rho « MAX RHO) && (Dmajor » MIN DMAJOR)) 


( 
/* The REGION passed the three requirments to be a line.*/ 


l - create line(r,M20,M11,M02,Dmajor,Dminor,Rho); 


/* Add new IMG LINE to IMG LINE list in order by IMG. LINE 
length, dmajor. */ 
if(Line list head -- NULL) 
( 
Line list. head - l; 


else if(l-»dmajor » Line list, head-»dmajor) 
{ 
l->next = Line_list_head; 
Line list, head - 1l; 

) 

else 

{ 

while((insert_pt->next != NULL) && 
(l->dmajor < insert_pt->next->dmajor) ) 


insert_pt = insert_pt->next; 
} 
l->next = insert_pt->next; 
insert pt-»next = l; 
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) /* end if second and third tests*/ 
) /* end 1£ first test.” 


/* void rgbalong_to_bwlong (long rgbalong, long *bwlong) 
/* 


= Converts color to black/white for rgba formatted pixels. 

y= The weights assigned for each color are television standards. 

A This function courtesy of M. Zyda. 

yt M e e eum mas eme em em emu mai me Eee Ee eem mem mm ime eM ewm aa el qe ce mee mer ce Cum mm me mm eem epe e e emm e e e rr EE E E AA */ 


rgbalong_to_bwlong(rgbalong,bwlong) 


long rgbalong; / input color rgbalong '/ 
long *bwlong; /* output b/w rgbalong  */ 


unsigned char red, green, blue, alpha; 
unsigned bw; 


/* Use bit masks to get RGB and alpha values from input rgbalong. */ 
red rgbalong & Ox000000ff; 
green = (rgbalong £ Ox0000ff00) >> 85 


blue = (rgbalong £ Ox00ff0000) >> 16; 
alpha = (rgbalong £ Oxff000000) >> 24; 
E == AO T500 0er intr anad e alpha a e a l ha); 
/* Calculate the black&white intesity using NTSC standard. 
intensity = 0.299(red) + 0.587 (green) + 0.114(blue) a 


bw = (0.299*red) + (0.587*green) + (0.114*blue); 


/* Save the black&white intensity in bwlong. */ 
*bwlong = (alpha<<24) | (bw<<16) | (bw<<8) | bw; 


gray=bw; 
} 
put m— M ——— € UR MR EUER E E em dar M E E E car en m em emt um a ca cm E m em emn m E e me cm eme ree em den e ee x / 
/* void set pixel white (long *rgbalong) 
M 


^ Sets the specified long integer pointed to by rgbalong to be 
as white by setting all RGB bits to ff (255 dec -> max intensity). 


set_pixel_white(rgbalong) 


long *rgbalong; 
{ 


8l 


mrogbatongoz cOxftfffffff:;: 


/* void set pixel black (long *rgbalong) 

TEE 

VES Sets the specified long integer pointed to by rgbalong to be 
X black by setting all RGB bits to 00 (0 dec -» min intensity). 


set pixel. blackí(rgbalong) 
long *rgbalong; 


xrgbalong = 0xff000000; 


/* A als a e AO A A A A RM Rr ccce a A A A * 
/* void write all lines (long x, long y) 
2 
eS Write to output file "name.text". 
/* c E E ee mee eei eme me emi em A mmis ee dem rem ent ae cel ea ea de Tenia ee ea ee emm A E, Lp IO A sl em > x 
write_all_lines(x,y) 
long x, yY; /* the x,y dimensions of the image */ 
( 


IMG LINE *1 - Line list head; 
FILE *lines. file; 


lines file - fopen("lines.text","w"); 
fprintf(lines file,"--- DATA FOR EXTRACTED LINE SEGMENTS ---\n"); 
fprintf(lines file,"Image size: nr pixels x axis = %d, nr pixels y axis 
BCIN K y); 
fprintf(lines file,"Extracted line segments listed in order by 
Tengt mem) 


while(1!-zNULL) 
( 


fprintf(lines file,"$s» length - $.4f, thinness = %.4f, orientation 
Es EE em OO CN, 
l->name, 1->dmajor, 1->rho, 1->phi, 1->m00); 


fprintf(lines file,"endpoints: ($.2f %.2f) (9$. 2F t$ .2F)XnVnM 
]-»plisixeL-5pDI Vv Ud --p2.x4b-5D229)5 
l = l->next; 
) 


/* £close(lines. file);*/ 


printf("\nLines found in image written to: 'lines.text'"); 
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APPENDIX C - IMAGE UNDERSTANDING ROUTINES 


The following routines provide implementation for the imageTest.c routine. 
The files included are the following: 

user.h, displayCtrl.h, displayCtrl.c, acquisitionCtrl.h, 
acquisitionCtrl.c, imsControl.h, imsControl.c, imagelog.h, imagelog.c. 
They are located in the -yamabico/vision96 directory. 


BEER Xo X ROO KE xx x EX A EET 


) 

FILENAME: imageTest.c 

DESCRIPTION: This file contains image test routines 
REVISION HISTORY: Leonard V. Remias and Khaled Morsy, Winter 96' 


some fragments from Kisor 
E RR SR AR RR Re RRR RAR AR E e 


DA de da a 


To shorten the descriptions below several abbreviations are used: 
AM: Acquisition module 
DM: Display module 


A0: Frame AO 

Al: Frame Al 

Bl: Frame Bl 

Acq: acquisition (as in waitAcq, waitAquisition) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 


reference Manual for series 150/40 
EM A Re p 


include "user.h" 

#include "displayCtrl.h" 
Anice luđe "acquisitionCtrl.h" 
#include "imsControl.h" 


E *~ Local Prototypes *****/ 


int 

getChoice (void); 

Gets the menu choice that is desired 
2 


void 

interlacePage2(void); 

/* Copies the page 2 part of an interlaced image into between the lines 
** of page one of the interlaced image to make a truely interlaced picture 
ey 
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void 
copylmageToMemory(IMSPage frameNumber); 


void 
copyImageToFrame (IMSPage frameNumber) : 


int 
user()( /* lvr test program for grabbing/snapping an image */ 


BOOLEAN readyToExit - FALSE; /* The exit flag */ 


while (!readyToExit) 
switch (getChoice()) ( 
case 1: /* Start grabbing images */ 
setInputPath(Al, CAMERA); 
setInputPath(Bl, CAMERA); 
setInputPath(A0, CAMERA); 
puts ("Input paths set: Camera->A0, Camera->A1l and CAMERA->B1"); 


setFrameAcquire(A0, GRAB); 
setFrameAcquire(Al, GRAB); 
setFrameAcquire(B1, GRAB); 
puts("Set up to grab images into frames A0, A1 and B1"); 


CycleThroughLEDs(); 
acqEnable(); 

puts("Frame has been grabbed"); 
break; 


case 2: /* Stop grabbing images */ 
setInputPath(Al, CAMERA); 
setInputPath(Bl, CAMERA) ; 
setInputPath(A0, CAMERA); 
puts ("Input paths set: Camera->A0, Camera->A1 and CAMERA->B1"); 


setFrameAcquire(A0, FREEZE); 

setFrameAcquire(Al, FREEZE); 

setFrameAcquire(Bl, FREEZE); 

puts("Stop grabbing images into frames AO, A1 and B1"); 
break; 


case 3: /*Snap an image */ 
setInputPath(Al, CAMERA) ; 
setInputPath(Bl, CAMERA); 
setInputPath(A0, CAMERA) ; 
puts ("Input paths set: Camera->A0, Camera->Al and CAMERA->B1"); 
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setFrameAcquire (AQ, SNAP); 
setFrameAcquire(Al, SNAP); 
setFrameAcquire(Bl, SNAP); 
puts("Set up to Snap an image into frames AO, A1 and B1"); 


cycleThroughLEDs () ; 
acqEnable(); 

puts("Frame has been snapped"); 
break; 


case 4: /* Zeroize (clear) pixel data in all frames B1 */ 
setInputPath(A1, CONSTANT); 
set InputPath (Bi, CONSTANT); 
setInputPath(A0, CONSTANT); 
puts ("Input paths set: Constant->A0, Constant->A1l & Constant- 
EHI"); 


setFrameAcquire(AO, SNAP); 
setFrameAcquire(A1, SNAP); 
setFrameAcquire(Bl, SNAP); 
puts ("Set up to Snap an image into frames AO, A1 and B1"); 


cycleThroughLEDs () ; 
acqEnable(); 

puts("Frame has been snapped"); 
break; / 


case 5: /* Zeroize (clear) 1 MByte frame page AO */ 
interlacePage2(); 
break; 


case 6: /* Zeroize (clear) 1 MByte frame page AO */ 
setFirstKToConstant(AO, 0x0000); 
break; 


case 7: /* Zeroize (clear) 1 MByte frame page A1 */ 
setFirstKToConstant(A1, 0x0000); 
break; 


case 8: /* Zeroize (clear) 1 MByte frame page B1 */ 
setFirstKToConstant(B1, 0x0000); 
break; 


case 9: 
selectPage(A0); 
puts ("Frame A0 selected"); 
readyToExit = TRUE; 
break; 
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case 10: 
selectPage (A1); 
puts ("Frame Al selected"); 
readyToExit - TRUE; 
break; 


caseta: 
selectPage(B1); 
puts("Frame Bl selected"); 
readyToExit = TRUE; 
break; 


case 12: 
selectPage (AM); 
puts ("Acquisition module selected"): 
readyToExit = TRUE; 
break; 


case 13: 
selectPage (DM); 
puts("Display module selected"); 
readyToExit = TRUE; 
break; 


case 14: 

ImageLog (NULL, 0); 
copylmageToMemory (B1); 
readyToExit - TRUE; 
break; 


case 15: 
copylIlmageToFrame (B1); 
break; 


default: 
puts("Error:main - Illegal option selected"); 


rexit | 


int 
getChoice (void) 
/* Gets the menu choice that is desired 


d E 


puts("\n\nWhat would you like to see?"); 

printf("in Enter 1 Start grabbing images."); 

printf("\n Enter 2 Stop grabbing images."); 

printf ("in Enter 3 Snapshot (snap an image)"); 

printf("\n Enter 4 Zeroize (clear) pixel data in all frames."); 
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Interlace the image. 0: 

Zeroize (clear) 1 MByte frame page A0"); 
print An En er Zeroize (clear) 1 MByte frame page A1"); 
praintf('"Xn" EHter Zeroize (clear) 1 MByte frame page B1"); 
printf("in Enter 9 Exit with frame AO selected"); 

printf ("\n Enter 10 Exit with frame Al selected"); 

printf("\n Enter 11 Exit with frame Bl selected"); 

printf ("in Enter 12 Exit with Acquisition Module registers selected"); 
printf ("Nin Enter 13 Exit with Display Module registers selected"); 
printf("\n Enter 14 Copy image from IMS frame Bl to Sparc Memory"); 
printf("\n Enter 15 Copy image from Sparc memory to IMS frame Bl "); 


print" niente 
printf("\n Enter 


or aw 


priant£("inin The choice 3s : "); 
peturn( GetInt() ); 


void 

interlacePage2 (void) 

/* Copies the page 2 part of an interlaced image into between the lines 
** of page one of the interlaced image to make a truely interlaced picture 
zt 

Ent 1, j; 

unsigned long pagelIndex = Oxfa000000; /* First empty line for pg2 pixels 
e 

unsigned long page2Index - Oxfa07a400; /* First 1K of pixels on page 2*/ 
unsigned long pagelDestination = 0xfa000800, 

unsigned long page2Source = 0xfa07a400; 


selectPage(B1); 


for (i20; 1<236; i++) { 
printf ("The indexes are now %x and %x.\n",pagelIndex, page2Index) ; 

for (350: j3<366; j++) { /*732 bytes but 2 bytes per access */ 
* (WORD*)pagelDestination = * (WORD*) page2Source; 
pagelDestination += 2; 
page2Source += 2; 

} 

pagelIndex += 0x800; 

page2Index += 0x800; 

pagelDestination = pagelIndex; 

page2Source = page2Index; 
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YAMAIMAGE blImage; 
BYTE image[476] [732]; 


void 

copylmageToMemory(IMSPage frameNumber) 
/* Put comments here 

n 

( 


unsigned long pagellndex - Oxfa000000; /* First empty line for pg2 pixels 
ed 

unsigned long page2Index = Oxfa07a400; /* First 1K of pixels on page 2*/ 
unsigned long pagelSource - Oxfa000000; 

unsigned long page2Source - Oxfa07a400; 


ine ij, 
int xSize = 732; 
int ySize = 476; 


blImage.xSize = xSize; 
blImage.ySize = ySize; 


printf ("IM IN copyImageToMemory functionin"); 


for (i=0; 1<238; 1+=2) 

{ 
for (j3=0; j<366; j+=2) /*732 bytes but 2 bytes per access*/ 
{ 


blImage.imageíi][j] = * (BYTE*)pagelSource; 
pagelSource += 2; 


blImage.imageli+1][3] = *(BYTE*)page2Source; 
pagelSource += 2; 


pagel Index += 0x800; 
page2Index += 0x800; 
pagelSource = pagelIndex; 
page2Source = page2Index; 


LogImage (b1lImage) ; 
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ISSO OA al 


static int GetWheelEncoder (LONG HighWordAddress, LONG LowWordAddress) 


( 
LONG Wheel; 


Wheel * (WORD*)HighWordAddress; 
Wheel = Wheel << 16; 
Wheel += *(WORD*) LowWordAddress; 


return Wheel; 


ES KK / 


void 
copylmageToFrame(IMSPage frameNumber) 
/* Put comments here 


ES 1 


unsigned long pagelIndex = 0xfa000000; /* First empty line for pg2 pixels 
p 

unsigned long page2Index = Oxfa07a400; /* First 1K of pixels on page 2*/ 
unsigned long pagelSource = 0xfa000000; 

unsigned long page2Source = 0xfa07a400; 


ma rtverrorAddress = 0; 


ESL O1, j; 


for(i=0; i<476; i++) { 
for (320;934«732; j**) ( /*732 bytes but 2 bytes per access */ 
*(BYTE*)pagelSource - blImage.image[ai]íj]l; 
pagelSource++; 


) 
pagelIndex += 0x400; 
pagelSource - pagelIndex; 
) 
if (errorAddress) 
printf("There are differences in the frame and sparc memory!\n"); 
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O Re de EE RE OE Ke Kok ke he oe De A ek ok Kk KK CK KK RA 


/*file user.h 

/*This files includes the various files for integrating the image routines 
with MML and for setting up the system to upload/download image data 
AM LLL LUE ee ee ee eT OEE EER KK EERE KEK EKER KE ER RAK, 
#include <math.h> 

#include “definitions.h” 

tinclude "stdiosys.h" 

tinclude “serial.h” 

tinclude “trace.h” 

tinclude “geometry.h” 

tinclude “time.h” 

#include “segcmd.h” 

#include "system.h" 

#include "memsys.h" 

#include "imagelog.h" 


Y O O O OS O E SA EEES 


FILENAME: displayCtrl.h 

DESCRIPTION: This file contains prototypes for the low 
level image routines that manipulate the 
display module registers. 

REVISION HISTORY: jck: LT John Kisor USN Winter 95' 

delc 050110 

Ae AK Be KR OR eR RE RR RR RR OR RRR TOR A TOR AS II Renee 

JNC EES R Ra 


940112 Find out how much of Sparc's memory is currently used. 
PO Kx EORR 


typedef enum ( NI800by600, /* 800x600 non-interlaced */ 
NI640by480, /* 640x480 non-interlaced */ 
NI1024by768, /* 1024x768 non-interlaced */ 


RS170, /* RS170 512x480 interlaced */ 
CCIR, A CCIR 512x512 interlaced */ 
RS170SQ, /* RS170sq 640x480 interlaced */ 
CCIRSQI1, /* CCIRsq 768x512 interlaced */ 
CCIRSQ2, J/* CCIRsG 768x574 interlaced */ 
OneKbyOneK /* 1024x1024 interlaced */ 

) MONITORS; 


vord 

initDisplay(MONITORS monitorType); 

/* Configure the display module to display images on the 
** selected monitor. See DM reference manual 

e 


void 
resetDMCtrl (void); 
/* resets the communication between the host and the GSP 
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P4 


void 

initGSP (void); 

/* write causes the GSP to enter a reset state. Reading causes the GSP to 
** exit the reset state See sect 3.1.5 of the DM Ref Man 

** Show Mike this!!! 

A 


int 

checkDMId(void); 

/* checks that the correct version of the display module is present. 
** See sect 3.1.6 of the DM Ref Man 

ud 


void 

selectMonitor(MONITORS monitorType); 

/* Initializes the display modules GSP for the monitor specified 
** See sect 3.2.3 of the DM Ref Man 

a7 


void 

writeDACLUT (void); 

/* Writes a one to one coorespondence LUT for the output of RGB values 
** An input of O sets R:0 G:0 € B:0, an input of 1 sets R:1, G:1 & B:1 
etC... 

**See sect 3.3.2, 3.3.3 and 3.3.4 of the DM Ref man. 

sy 


void 

writeOverlay(void); 

/* Sets al overlay color mappings to zero (clear) 

** No overlays will be shown only the image. 

**See sect 3.3.6, 3.3.7 and 3.3.8 of the DM Ref man. 
of 


es Re AE EAE EEA KE EK EEE REE EEE ES AS A el dran 


FILENAME: display Cel 

DESCRIPTION: This file contains the code to produce output from the 
the ITI display module 

REVISION HISTORY: jck: LT John Kisor USN Winter 95' 

Icek 950110 


DR da Pe GR RR IE RK RRS EEK EE RR oko o koe ee 


9] 


dP EE P c kk kk ok Kee kb ke A n A x 


der 250111 

To shorten the descriptions below several abbreviations are used: 
AM: Acquisition module 

DM: Display module 


A0: Frame AO 

Al: Frame A1 

Bl: Frame Bl 

Acq: acquisition (as in waitAcq, waitAquisition) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 
reference Manual for series 150/40 

DM Ref Man: Imaging Technology INc's DM-PC Hardware Reference Manual 


Ne He Pe Re Re AR RO RO Pe eo ok e kc e ke ke ek o e t 4 x xx / 


tinclude "definitions.h" 
#include "system.h" 
#include "stdiosys.h" 


tinclude "imsControl.h" 
#include "displayCtrl.h" 


/* Local prototypes */ 


void setGSPAddress(WORD MSBofGSPAddress, WORD LSBofGSPAddress); 

/* Sets up the address of that GSP that will either be written or read 
** See sect 3.1 of the DM Ref Man 

5 


void 

writeToGSP(WORD gspData); 

/* Writes some data to a GSP address 

** See section 3.1.1, 3.1.2 and 3.1.3 of DM Ref man 
E. 


WORD 

readFromGSP(void); 

/* Reads some data from a GSP address 

** See section 3.1.1, 3.1.2 and 3.1.3 of DM Ref man 
T 


WORD 

getGSPAddress(void); 

/* Test routine to see what values are being set into the DACLUT 
** write address 


dl 
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void 

zeroizeGSPMemory(void); 

/* Zeroizes the program and overlay memory in the GSP 
** See sect 3.2.1 and 3.2.2 in the DM Ref Man. 

7 


void 

initDisplay (MONITORS monitorType) 

/* Configure the display module to display images on the 
** selected monitor. See DM reference manual 


E 1 


cycleThroughLEDs(); 
selectPage (DM); /* Select the display module */ 
puts("Display Module Registers Selected"); 


if (checkDMId()) 
puts("Correct DM present"); 
else 
puts("ERROR-- incorrect DM present"); 


resetDMCtrl(); 
puts("Communication between the host and GSP reset"); 


initGSP(); 
puts("Resets the GSP state"); 


cycleThroughLEDs(); 
selectMonitor( monitorType ); 


WriteDACLUT(); 
puts("Writing to the DACs LUT"); 


writeOverlay(); 
puts("Writing zeros to overlay"); 


void 

resetDMCtrl(void) 

/* resets the communication between the host and the GSP 
E í 

const dmCtrlReg - Oxfa000006; 


const zero - 0x0000; 


*(WORD*)dmCtrlReg - zero; 


void 

initGSP (void) 

/* write causes the GSP to enter a reset state. Reading causes the GSP to 
** exit the reset state See sect 3.1.5 of the DM Ref Man 

** Show Mike this!!! 

AE 


const displayControl - Oxfa000006; 
const GSPResetReg = O0xfa000008; 
const resetZero = 0x0000; 
const setIncrements = 0x0000; /* NO increment after write */ 
const cacheFlush = 0x4000; /* flush the old program from the cache */ 
WORD contents; 
*(WORD*)displayControl - ( setIncrements | cacheFlush ); 


* (WORD* )GSPResetReg = resetZero; 
contents = *(WORD*)GSPResetReg; 


zeroizeGSPMemory(); 


nt 

checkDMId (void) 

/* checks that the correct version of the display module is present. 
** See sect 3.1.6 of the DM Ref Man 


m X 
const modVersion = 0xfa00000c; 
const correct Version = OXILES; 


ine status; 


if ( *(WORD*)modVersion & correctVersion)( 
puts("Correct display module installed for cohu4110"); 
Status - 1; 
) 
else ( 


puts("Error - checkDMId():Incorrect display module installed"); 

printf("$d does not equal %d\n", *(WORD*)modVersion, 
correctVersion); 

status -0; 
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return status; 


void 


selectMonitor(MONITORS monitorType) 
/* Initializes the display modules GSP for the monitor specified 
** See sect 3.2.3 of the DM Ref Man 


ay í 


const lowAddrReg 
const highAddrReg 


const dataPortReg - 


WORD offset[12] = 


AnG i; 


KORD monitorinfto[1][12] = { 


EOXE OO, 
0x0005, 
20 007).) : 


MEM eX 


Nox EO, 


0:005. "05:001 27 


fo x1 010, 
Ox0005, 
60005) ) ; 


(0x9020, 
0x0005, 
0x0247), 


(0x9020, 
0x0009, 
0x0a47), 


(0x9020, 
Doom Odes 
0x064d), 


(0x9020, 
OxOOO09, 


0x00cc, 
0x0017, 


Ox00ce; 


OXIE, 
0x00le, 


Dx0cc. 
Ox 0005, 


OxO0ce, 
0x0006, 


Ox00ce, 
Ox0008, 


cO COS 


Oxfa000000; 
Oxfa000002; 
Oxfa000004; 


(0x0080, 
0x0010, 0x0020, 


Ox000d, Ox006f, O0x007b, 0x00017 05:000 37 


Ox00b0, Ox0090, Ox0000, 


0x00507 0x0040,- 0x005070x006079 05:00 2008 D0::00 00) 


OxcOOc, /* 800x600 non-interlaced */ 
0x007d, 0x0085, O0x000e, Ox0014, Ox026d, 0x0270, 
OxcOOc, /* 640x480 non-interlaced 

0x0064, 0x006a, 0x000e, 0x0015, Ox01f£6, Ox01f£9, 0Ox002d) 
0xc00c, /* 1024x768 non-interlaced 
0x00a0, 0x00a7, 0x0000, OxOO14, 0x0315, 0x0318, 
scele PE CRSLIO 
00047 00x004t2205»:0005903x:0011 T0010 9-05: OO 
0xcOD0Cc, Z*"COCTER 
0x0048, 0x0055, Ox0001 0-00 14 0x01 1S 00153. 
0xc00c, /* RS170sq 
0x005a, 0x006f, 0x0003, 0x0012 0x0103, 0x0260, 
Oxc00c, /* CCIRsq1 NO value given for [rI] Uu 


0x01547 0x014c- 0xe5c)., 
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00x:9020 M 0:00c6c OxcO0c, /* CCIRsq2 


Moo OO DOC, Ox006f, 0x09075, 0x0001, 0x0013, 0x0134, 0x014c, 
Ox0e5c), | 


19205020. 203:00c65, 5 0xc00c5 —4*- 1024x1024 


0x000d, 0x001da, 0»x009£, 03:00a9, 0X0007, 0x0024, 0x0225, 0x0225b. 
0x010b}}; 


Za 
printf ("Monitor 0 (1024x768) values are:\n ("); 
for Or ac 4) 
Prints. "o monlitorimato(0 [110 
o y 


for(i=0; i<11; i++) { 


* (WORD* ) lowAddrReg  - offset[1i]; /* offset in GSP address 
space */ 
* (WORD* )highAddrReg = 0xc000; /* high order word for GSP internal 
Reg* / 
* (WORD* )dataPortReg = monitoriInfo[0] [i]; 
printf("Writing to:%x%x the value:%x\n" ,* (WORD*)highAddrReg, 
* (WORD* ) lowAddrReg, 
* (WORD* ) dataPortReg) ; 
} 
* (WORD* ) lowAddrReg = 0x0000; /*Offset for control register, in GSP 
space* / i l 
* (WORD*)highAddrReg = 0x0100; /* high order word for "local" 
registers */ 
* (WORD*)dataPortReg = monitorInfo[0] [11]; 


printf ("Writing to:%x%x the value:%x\n", *(WORD*)highAddrReg, 
* (WORD* ) lowAddrReg, 
* (WORD*) dataPortReg); 


void setGSPAddress(WORD MSBofGSPAddress, WORD LSBofGSPAddress) 
/* Sets up the address of that GSP that will either be written or read 
** See sect 3.1 of the DM Ref Man 


LE 

const lowAddrReg = 0xfa000000; 

const highAddrReg - O0Oxfa000002; 
*(WORD*)lowAddrReg = LSBofGSPAddress; 


* (WORD* ) highAddrReg MSBofGSPAddress; 
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void 
writeToGSP(WORD gspData) 
/* Writes some data to a GSP address 


** See section 3.1.1, 3.1.2 and 3.1.3 of MM Ref man 
E t 


const dataPortReg - Oxfa000004; 


* (WORD* )dataPortReg = gspData; 


WORD 
readFromGSP (void) 
/* Reads some data from a GSP address 


E Sco section 3.1.1, 3.1.2 and 3.1.3 of EMBRef mén 
T ( 


const dataPortReg - Oxfa000004; 


WORD gspData; 


gspData = * (WORD*)dataPortReg; 


return gspData; 


WORD 
getGSPAddress (void) 


/* Test routine to see what values are being set into the DACLUT 
** write address 


E. t 
setGSPAddress(0x0100, 0x0080); 
return( readFromGSP() ); 


void 
writeDACLUT (void) 


/* Writes a one to one coorespondence LUT for the output of RGB values 
** "An input ot 0 sets R:0 G:0 & B:0, an input of 1 Sets vi SL 
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etc... 
“See sect 3.3.2, 3.3.3 and 3.3.4 of the DM Ref man. 


UE 


WORD i, z; 
WORD LUTValue; 


setGSPAddress(0x0100, 0x00a0); /* Address of mask register */ 
writeToGSP(Oxffff); /* Set to NO masking in DAC */ 


setGSPAddress(0x0100, 0x0080); /* GSP DAC LUT write address - 2 */ 
writeToGSP (0x00ff); 


setGSPAddress(0x0100, 0x0090); 
~ readFromGSP(); /* Read RED value */ 
/*  xeadFromGSP(); /* Read GREEN value, now LUT has pre-read next RGB */ 


for(i=0; 1<256; i++) /* For each pixel grayscale value */ 
for(z=0; z<3; z++){ /* for the red, green and blue DACs */ 
writeToGSP (i); 
/* Address is self incrementing after 3 writes (RG and B DACs)*/ 


} 


/********* Debugging code from here down, remove later jck ****/ 

Jt This code prints out the values that are stored in the DAC LUT */ 
setGSPAddress(0x0100, 0x00b0); 
writeToGSP(0x00ff); 


setGSPAddress(0x0100, 0x0090); 


printf("TESTING:Values of GSP DAC LUT are..... mue 
for(i=0; i<256; i++) 
fonizs0 «35 Zt) { 
LUTValue = (readFromGSP() & OxOOff); 
printe (td) "| LUTValue);, 
) 


printf (nenda of yLUT valmes ma 


[RENAE AR ee 


} 


void 
zeroizeGSPMemory (void) 
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/* Zeroizes the program and overlay memory in the GSP 
** See sect 3.2.1 and 3.2.2 in the DM Ref Man. 
nf 


const displayControl = 0xfa000006; 


const incrementOnRW - 0x1800; /* Auto increment on reads and writes- 
* f 
const nolncrementOnRW = OxeTff; 


WORD oldDisplayControl; 
TORD I, J, Zi 


oldDisplayControl = *(WORD*)displayControl; /* turn on auto increment 
n 
*(WORD*)displayControl - ( oldDisplayControl | incrementOnRW ); 


printf("Zeroizing GSP program and overlay memory"); 
setGSPAddress(0x3800, 0x0000); 


fer (z=0; 2<8; 244) { L* from38,000000tONMSR Frob ta 
prrnte ) 
for(1=0; 1<1024; 1++) /* 1l -meg (1024 1Ks) */ 
for (J=0; J]<-1024; JTI) /*3800000 -» 3bfffff is program memory*/ 
writeToGSP(0x0000); /*3c00000 -» 3cfffff is overlay memory */ 


) 
mime (Vn > 


ENdbpisplayControl 2 *(WORD*)displayControl; /* turn off auto anerement 
fy 
*(WORD*)displayControl - ( oldDisplayControl & noIncrementOnRW ); 


void 

writeOverlay(void) 

/* Sets al overlay color mappings to zero (clear) 

** No overlays will be shown only the image. 

**See sect 3.3.6, 3.3.7 and 3.3.8 of the DM Ref man. 


a 


WORD i, Z; 
WORD OverlayValue; 


setGSPAddress(0x0100, Ox00bf); /* GSP DAC overlay write address */ 
writeToGSP(0x00f£f); /* Start at zero minus one */ 
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setGSPAddress(0x0100, 0x00d0); /* GSP DAC overlay data address */ 
readFromGSP(); /* Read RED value */ 
readFromGSP(); /* Read GREEN value, now LUT has pre-read next RGB */ 


for(i-0; i«256; i++) /* For each pixel grayscale value */ 
for(z=0; z<3; z++){ /* for the red, green and blue DACs */ 
writeToGSP(0x0000); 
/* Address is self incrementing after 3 writes (RG and B DACs)*/ 


) 


/********* Debugging code from here down, remove later jck ****/ 


y^ This code prints out the values that are stored in the DAC LUT */ 
setGSPAddress(0x0100, Ox00f0); 
writeToGSP (/0x00fE) ; 


setGSPAduress (CxA100, Ox00d0); 


printf("TRSTING:Values of GSP DAC Overlay are..... NIS 
COL (te BO +) 
fortes 42-3 072442) 1 
OverlayValue - (readFromGSP() & OxOOff); 
printf("$d, ",OverlayValue); 
) 


printf£("\nEnd of Overlay values\n"); 


A A A A Ree pd es 


FILENAME: acqTest.h 
DESCRIPTION: This file contains prototypes for the low 
level routines for the setting up the acquisition module 
REVISION HISTORY:  jck: LT John Kisor USN Winter 95' 
jck 950110 


EEN EE D CE RA E EE EK ARE RUNE XE A AE DEKO koc ERE 


int checkAMVer(void); 
/* Checks for the correct acquistion module version (i.e. 8 bit RS422) 
** See Section 3.2 in the AM Ref Man 


uri 


void 

initAcqModule (void); 

/* Initializes the aquisition module 
n 


void 
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setCameraClockCtrl(void); 

/* Sets the camera output clock frequency to the CCLK pins on the camera 
** See Sect 3.3 in the AM Ref Man. 

L4 


void 

setCameraTimingCtrl(void); 

/* Sets up the timing interface to the camera 
** See 3.4 of the AM Ref Man 

E 


Dod 

setExtSyncCtrl(void); 

/* sets the EXSYNC frequency, length and polarity 
** See sect 3.5 in AM Ref man 

E 


void 

setSyncTime(void); 

/* sets the duration of the EXSYNC pulse output 
** Ser Sect 3.6 in AM Ref Man 

y 


void 

EESEIEUECEtrl(void); 

/* sets the page size and output data path 
** See sect 3.7 of AM Ref Man 

"y 


void 

setHorizOffset(void); 

/* Sets the location of the first valid pixel of each line relative 
** to the selected edge of the LEN input 

oy 


void 

setHorizActive(void); 

/* sets the number of valid pixels in each line. When horizontal offset 
** reaches zero the AM enables the horizontal counter and tarts loading 
** the line FIFOs. See sect 3.10 in AM Ref Man 

Py 


void 
setVertOffset(void); 
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/* Sets the location of the first valid line of each frame relative to the 
** selected edge of FEN input.When the AM offset counter reaches zero, the 
** AM signals the mother board that the first line is ready. 

** See sect 3.11 in the AM Ref Man 

E 


void 

setVertActive(void); 

/* Sets the number of valid lines in each frame. When the vertical offset 
** counter reaches zero, the AM starts unloading lines from the FIFO to the 
** mother board. See sect 3.12 AM Ref Man 

ay 


vola 

initAMTrigger (void); 

/* initializes the AM trigger register. See sect 3.13 in AM Ref Man 
2 


int 

enableAMTrigger(void); 

/* Enables the AM trigger mode. This bit is cleared when a trigger occurs. 
** Tt cannot be set while a trigger cycle is in progress. 

** See sect 3.13.1 in AM Ref Man 

un 


Int 

enableSoftTrigger (void); 

/* Enables the use of a software trigger as opposed to a trigger from the 
** camera. See Sect 3.13 in AM Ref man. 


ay 


void softTrigger(void); 

/* Causes an external trigger pulse to the AM, if the software trigger is 
** enabled. See sect 3.15 in AM Ref Man. 

phi 


WR E cR E E A O A EA Ses 


FILENAME: acquisition erl. c 

DESCRIPTION: This file contains the image code for the acquistion 
module 

REVISION HISTORY: jck: LT John Kisor USN Winter 95' 


ele 9501101 


RR RX Re e e e e e e ke oe e e e oe ce e e ee e e e Re RE RE Je Pe Re e ke RE ke ke ke e e RE RE e e e eee e e dE o RE e kk KK AAA S 
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JE FAX ENE Notes**********k***x 
FAX941028 refers to a fax received from ITI regarding the acquistion 
registers. 

Most of the values for these routines were obtained from that fax. 


SUE EE RERO EE LA Lt 


SE ERARIO O 


ek 950111 

To shorten the descriptions below several abbreviations are used: 
AM: Acquisition module 

DM: Display module 


A0: Frame AO 

Al: Frame AI 

Bl: Frame Bl 

Acq: acquisition (as in waitAcq, waitAquisition) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 
reference Manual for series 150/40 


AM Ref Man: Imaging Technology Inc's AM-DIG Hardware reference manual 
De RE Re RR RE EE RE RE EE P he RE EE RE RK RK EX / 


#include "definitions.h" 
#include "system.h" 
#include "stdiosys.h" 


inerude "acquisitionCtri.h" 
include "imsControl.h" 


void 

initAcqModule(void) 

/* Initializes the aquisition module 
E 1 


selectPage(AM); /* Select the acquistion module */ 
puts ("Acquisition Module Registers Selected"); 


if (checkAMVer()) 
puts("Correct AM present"); 
else 
puts("ERROR-- incorrect AM present"); 


setCameraClockCtr1(); 
setCameraTimingCtrl(); 
setExtSyncCtr1l(); 
setSyncTime(); 
setcLucCtrl(); 
setHorizOffset(); 
setHorizActive(); 
setVertOffset(); 


Ser ventActive 
DC MEC acer): 


tant tra oger Cor come from camera ******** 
enableAMTrigger(); 
enableSoftTrigger(); 
softTrigger()}; 


KKKKEKKKK K / 


} 


int checkAMVer (void) 

/* Checks for the correct acquistion module version (i.e. 8 bit RS427) 
** Gee Section 3.2 in the AM Ref Man 

E ores 

const modVersion = Oxfa000002; 


Gonctrconpsecct versione 0xftft03: 


int status; 


if ( *(WORD*)modVersion & correctVersion) { 
puts("Correct acquistion module installed for cohu4110"); 
status - 1; 
) 
else { 
puts("Error - checkModuleVer():Incorrect acquistion module 


installed"); 
printf("$d does not equal d\n", *(WORD*)modVersion, 
correctVersion) ; 
status =0; 
} 


Eebpuni status 


void 

setCameraClockCtrl(void) 

/* Sets the camera output clock frequency to the CCLK pins on the camera 
** See Sect 3.3 in the AM Ref Man. 

S t 


const cohuClockCtrl = 0xfa000004; 
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const cloeckPFred - 0x0000; /* set internal clock frequency to 14.32 MHz 
i 

const clockDivisor 
const xillixMode 
const modeCtrl 


0x0000; /* Divide that clock frequency by one */ 
0x0000; /* not a Xillix camera */ 
0x0e00; /* Mode control bits SeeFAX941028*/ 


! 


* (WORD* icohuClocketr le cllociEEed | 
clockDivisor | 
xillixMode | 
modeCtrl); 

) 
void 


setCameraTimingCtrl(void) 

/* Sets up the timing interface to the camera 
** See 3.4 of the AM Ref Man 

EJ 4 


const cobuTimeCtrl = 0xfa000006: 


const pixelClkPol 


0x0001; /* Sample data on falling edge of PCLK */ 
const lineEnablePol 


0x0002; /* Falling edge of LEN enables horiz 


il 


pxming*/ 
const frameEnablePol = 0x0000; /* Falling edge of FEN enables vertical 
Iunixng*/ 
/*jck!!! There is a conflict here. The fax token is "FEN NoInvert" this 


implies the rising edge of FEN will enable vertical timing, but the 
cooresponding comment reads://Falling Edge of FEN enables Vertical 
Timing. 
See sections 2.2.1.2 and section 3.4.3 in AM Ref Man. */ 


const fieldPolarity = 0x0000; /* Field input lwo defines even field */ 
const scanMode = 0x0000; /* Area scan mode */ 

const interlaceMode = 0x0020; /* Interlaced camera */ 

const LENSmall = 0x0000; /* Normal, LEN inactive period is greater */ 


/* than one PCLK cycle jck???*/ 
0x0000; /* Two lines inserted between line scan 


tt 


const NoLineMiss 
frames*/ 


const lineVariable 0x0200; /* Reset FIFO every FEN */ 


* (WORD*)cohuTimeCtrl = (pixelClkPol | 
lineEnablePol | 
frameEnablePol | 
fieldPolarity | 
scanMode | 
interlaceMode | 
LENSmall | 
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NoLineMiss | 
lineVariable ): 


void 

setExtSyncCtril (void) 

/* sets the EXSYNC frequency, length and polarity 
** See sect 3.5 in AM Ref man 


BU 


const cohuSyncCntrl = 0Oxfa000008; 


const syncFre:] = 0x0005; /* ext clk frequency: 14.32/2048=7Khz 
(143usec)*/ 

const symcMode = 0x0000; /* ExSync triggers itself jck??? poss 0x00 TOE 
const syncinarle = 0x0000; /* EXSYNC counter disabled */ 

const syncPol = 0x0040; /* EXSYNC high when triggered,....*/ 

const intEnable = 0x0000; /* programmable integration disabled jck??? */ 


const intPulsePol = 0x0100; /* PRI disabled - output always low */ 


*(WORD*)cohuSyncCntrl - (syncFreq 


| 
syncMode | 
syncEnable | 
syncPol | 
intEnable | 
intPulsePol ); 
) 
void 


setSyncTime(void) 

/* sets the duration of the EXSYNC pulse output 
** Ser Sect 3.6 in AM Ref Man 

ET 


const cohuSyncTime = Oxfa00000a; 
const hz2046 = 0X07fbD; 


* (WORD*)cohuSyncTime - hz2046; 


void 
setLutCtrl(void) 
/* sets the page size and output data path 
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** See sect 3.7 of AM Ref Man 
x ( 


const cohubutCtrl - Oxtao000U0Gr 


const pixelSize = 0x0000; 
const muxSetting - 0x0000; 


* (WORD*)cohuLutCtrl - (pixelSize | muxSetting); 


void 

setHorizOffset(void) 

/* Sets the location of the first valid pixel of each line relative 
** to the selected edge of the LEN input 

E { 


const horizOffset - Oxfa000010; 
const cohuOffset = 0x009a; 


ENLDJORD'OhorizOffset -ocohuOftfset: 


void 

setHorizActive(void) 

/* sets the number of valid pixels in each line. When horizontal offset 
** reaches zero the AM enables the horizontal counter and tarts loading 
** the line FIFOs. See sect 3.10 in AM Ref Man 

£1 


eonst horizActive - 0xfa000012; 
Eust cohuHorizActive - 0x02d8; 


* (WORD* )horizActive = cohuHorizActive; 


void 

setVertOffset (void) 

/* Sets the location of the first valid line of each frame relative to the 
** selected edge of FEN input.When the AM offset counter reaches zero, the 
** AM signals the mother board that the first line is ready. 

** See sect 3.11 in the AM Ref Man 
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ka 
const vertOffset - Oxfa000014; 


const cohuVertOffset = 0x0001; 


* (WORD*)vertOffset - cohuVertOffset; 


void 

setVertActive(void) 

/* Sets the number of valid lines in each frame. When the vertical offset 
** counter reacbes zero, the AM starts unloading lines from the FIFO to the 
** mother beard. See sect 3.12 AM Ref Man 

ERU 


const vertáctive - Oxfa000016; 
const cohuVertActive = OxOldc: 


* (WORD*)vertActive = cohuVertActive; 


void 

initAMTrigger (void) 

/* initializes the AM trigger register. See sect 3.13 in AM Ref Man 
Sd ui 


const trgyggerctrl - Oxfa000018; 


0x0000;/*trigger enabled*/ 
0x0000;/*External trigger from camera connector, 
trigger on falling edge */ 


const disableTrigger 
const triggerSource 


*(WORD*)triggerCtrl -( disableTrigger | triggerSource); 


int 

enableAMTrigger (void) 

/* Enables the AM trigger mode. This bit is cleared when a trigger occurs. 
** Tt cannot be set while a trigger cycle is in progress. 

** See sect 3.13.1 in AM Ref Man 

T 
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const triggerttrl = O0xfa000018; 


const enableTrigger = 0x0001; /* Trigger enabled */ 
const triggerNotActive - 0x0004; /*read-o, 1:No ext. trigger cycle in 
progress*/ 


int status; 
if ( ( *(WORD*)triggerCtrl & triggerNotActive))(/*trigger not in 


progress*/ 
* (WORD*)triggerCtrl = enableTrigger; 


status = 1; 
} 
else 
status - 0; 


return status; 


int 

enableSoftTrigger (void) 

/* Enables the use of a software trigger as opposed to a trigger from the 
** camera. See Sect 3.13 in AM Ref man. 


Bt 


const triggerCtrl - Oxfa000018; 


const enableTrigger 0x0001; /*Trigger enabled */ 

const triggerSource - 0x0002; /* Trigger comes from software trig. 
register */ 

const triggerNotActive - 0x0004; /*read-only,1:No ext.trigger cycle in 
progress*/ 


int status; 


if ( ( *(WORD*)triggerCtrl & triggerNotActive)){/* trigger not in 
progress */ 
*(WORD*)triggerCtrl - (enableTrigger | triggerSource); 


status = l; 
} 
else 
status 


Dr 


return status; 


void 
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softTrigger(void) 
/* Causes an external trigger pulse to the AM, if the software trigger is 
** enabled. See sect 3.15 in AM Ref Man. 


A 


const softwareTrigger = Oxfa00001c; 


const goEnable 


= 0x0000; 


* (WORD*)softwareTrigger = goEnable; 


NR A AA poe aa 


FILENAME: 
DESCRIPTION: 


imsSystem.h 

This file contains prototypes for the low 
level image routines that interface with 
the IMS and its modules 


REVISION HISTORY:  jck: LT John Kisor USN Winter 95' 


Jek 950110 


Rp xc E E IAEA Kx XXE A ER DL: 


TA *Notegs**x*xX*x*x 


940111 Have kelbe check code for style 
940112 Have to use constants instead of defines for clear/setMask masks 


940112 Find out how much of Sparc's memory is currently used. 
LS Ré ex Lu ed LE e Lcid s y 


typedef enum 


typedef enum 


typedef enum 


void 


( AO, /* image frame AO */ 
Al, /* image frame Al */ 
Bi. /* image frame Bl */ 
AM, /* acquistion module */ 
DM /* display module */ 
} IMSPage; 
{ CAMERA, /* Input will be the camera */ 
AOZERO, /* Input to AO will be all zeros */ 


CONSTANT, /* input will be value set in constant mask */ 
AOONES, /* input to AO will be all ones */ 
INAO, /* input will be image in frame AO */ 
INA1, /* input will be image in frame Al */ 
INB1 /* input will be image in frame Bl */ 
} INPUTPath; 


{ GRAB, /* Continuously grab an image */ 
SNAP, /* Snap only one image */ 
FREEZE /* Stop grabbing images */ 

} ACQUIREType; 
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cycleThroughLEDs (void); 
/* Visual positive reenforcement. Cycles through all the LEDS once 


"i 


void 

setFirstKToConstant(IMSPage pageNumber, WORD filler); 

/* Puts a selected bit pattern in the first 1K of a page so that 

** the difference between the pattern and image will be more noticable. 
m 


void 

fmt LMS (void) ; 

/* Initializes the IMS board to standard addressing w/1MB page size and 
** offset of 0x00 from the default address that is the beginning of 

** A24 space.(i.e. Oxfa000000) Then it selects the acquistion register 
** using the page register 

E 


void 

clearMask(IMSPage frameNum); 

/* Sets the mask to allow ALL bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 

7 


void 

setMask(IMSPage frameNum) ; 

/* Sets the mask to allow NO bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 

B 


void 

setAOIControl(void); 

/* Sets the video bus out of AOI mode. 
** See sect 3.9.4 in IMS Ref man 

D 


void 

selectPage(IMSPage pageNumber); 

/* Selects between the different image frames and modules on the IMS board 
p 


void 
setIMSControl(void); 
/* Sets the IMS control register. See section 3.11 of the IMS hardware Ref 


man 
E 
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void 

setFrameIRQ(void); 

/* The type of frame interrupt will be put here. 
** Currently not used. 


JP 


void resetFrameCtrl(IMSPage frameNum); 

/* Resets the controls for horizontal pitch, tiling and write zoom for 
** frames A0, Al and B1. See IMS Ref man 3.29, 3.34 

gi i 


void 

resetFramePanScroll(IMSPage frameNum) ; 

/* Resets a frame for no (zero) pan and scroll. See 3.21 of the IMS ref man 
ur 


void 

setXPortSwitch(void); 

/* Sets the cross-port switch for the application bus width and direction 
** This register must be set prior to setting any path registers 

** See AM Ref man sect 3.43 

oa 


void 

setInputPath(IMSPage selectedFrame, INPUTPath imageSource) ; 

/* Selects the source of the image that will be put into a particular 
** frame. See AM Ref Man 3.40, 3.41 and 3.42 

A 


void 

setFrameAcquire(IMSPage frameNum, ACQUIREType typeOfAcquire); 

/* controls the acquistion to frame AO, Bl or Al 

** The input cross port switch should be set prior to calling this func 
** Decision was made to have actual acquistions triggered by the 

** acquisition enable register (3.19 Ref man) 

xmi 


void 

acqEnable(void); 

/* This register controls the synchronous acquisition into the IMS 

** frame stores (see IMS ref man 3.19) This enables acquisition into the 
** frame stores when an acquire is pending in the IMS acquisition registers 
** and the frames waitAcq is set 

del 


o ee AA BE IO xo ERARIO 


B 


FILENAME: imsControl.c 


DESCRIPTION: This file contains the main image board control 
functions 

REVISION HISTORY: jck: LT John Kisor USN Winter 95' 

jck 950110 


RE RR RR REI EB CK NONU ROR EIE E EE dS S TE EE ee S y 


JR RE RX RO e ke e ke e e e e e e e e e e e e e n RARAS 


jck 950111 

To shorten the descriptions below several abbreviations are used: 
AM: Acquisition module 

DM: Display module 


A0: Frame AO 

Al: Frame A1 

Bl: Frame Bl 

Acq: acquisition (as in waitAcq, waitAquisition) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 


reference Manual for series 150/40 
MUR ae Be a PORC NOE RODEO GE GC 


#include "definitions.h" 
#include "system.h" 
#include "stdiosys.h" 


#include "displayCtrl.h" 
#include "acquisitionCtrl.h" 
#include “imsControl,h” 


Void 

setFirstKToConstant (IMSPage pageNumber, WORD filler) 

/* Puts a selected bit pattern in the first 1K of a page so that 
** the difference between the pattern and image will be more noticable. 
E ( 

unsigned long frame - Oxfa000000; 


inr 1, Z; 


selectPage (pageNumber) ; 
printf("Filling memory with 0x%x\n", filler); 
printf ("Filling line #+ S 
for (1=0; 1<450; i++){ /*only stuff we see, 1024 will clear entire 
frame*/ 
DE *r0) 
printf Wb"): 
else if (i « 100) 
Prine ADDII 
else if (i < 1000) 
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pousse) > 
else 
Paine GD VON \ Db!) 
pramtti( sd") 
for (z=0; z<1024; z++) ( 
* (WORD*) frame - filler; 
frame += 2; 


) 
Princi nu 


void 

cycleThroughLEDs (void) 

/* Visual positive reenforcement. Cycles through all the LEDS once 
A 


E 


resetAllLEDs(); 


LEDon(FIRST LED); 
LEDoff((LAST. LED) ; 


j = 0; 
for(i=0; i< 35000; i++) /* Emotional positive feedback for jck */ 
ARAS OOO 81 
changeLEDstate (FIRST LED-3): 
ieee (BAS ED DS A 
changeLEDstate (FIRST LED), 
spes de 
} 
else { 
changeLEDstate(FIRST_LED+3 + 1); 
J++; 
} 
) 
) 
void 


initIMS(void) 


UL 
XX 


* * 


*x * 


5 


Initializes the IMS board to standard addressing w/1MB page size and 
offset of 0x00 from the default address that is the beginning of 

A24 space.(i.e. Oxfa000000) Then it selects the acquistion register 
using the page register 


( 


const imsConfigReg = 0XfcC000600; 
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const standardAddressing - 0x04; 


const OneMegPage - 0x00; 
const baseAddressOffset = 0x0000; 
*(WORD*)imsConfigReg - (standardAddressing | OneMegPage | 


baseAddressOffset); 
puts("Setting IMS for A24/D16 with base address of 0x000 (fa000000)"); 


initDisplay( NI800by600 ); /* 800x600 non-interlaced */ 


initAcqModule(): 
puts("Acquisition module registers are set."); 


selectPage(A0); /* Select frame AO */ 


clearMask (AQ); 
clearMask(A1); 
ClearMask(Bl); 
puts ("Masks cleared for: A0, A1 and B1"); 


setAOIControl(); 
puts("Disabled AOI control."); 


Set IMSCOntrol(), 
puts ("Setting IMS control register"), 


resetFrameCtrl(A0); 
resetFrameCtrl(B1); 
puts("Reset frame control registers for AQ, Al and Bl"); 


resetFramePanScroll (AQ); 
resetFramePanScroll (Al); 
resetFramePanScroll(B1); 
puts("Set zero pan and scroll for frames AO, Al and Bl"); 


setXPortSwitch(); 
puts("Cross-port switch is set"); 


void 

ClearMask(IMSPage frameNum) 

/* Sets the mask to allow ALL bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 

Eo i 


const frameAMask =  Oxfc000608; 


115 


const frameBMask = Oxfc00060c; 
const frameAO0Mask -  Oxff00; 
const frameAlMask =  OxOOff; 


UNBERE.  /*Phis sets constant mask to 0x00 also 7 


const frameBlMask 
WORD oldFrameAMask - * (WORD*)frameAMask; 


printf("Clearing mask for frame: "); 
switch (frameNum) ( 


case A0: *(WORD*)frameAMask = (oldFrameAMask | frameAQMask) ; 
puts ("A0"); 
break; 
case Al: *(WORD*)frameAMask = (oldFrameAMask | frameAlMasX): 
puts("Al"), 
oreak; 
case Bl:  *(WORD*)frameBMask - (frameBlMask ); 
puts Blu 
break; 
default: 
puts("Error:clearMask - Illegal frame selected"); 
rexit(); 


void 

setMask(IMSPage frameNum) 

/* Sets the mask to allow NO bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 


S E 

const frameAMask = 0xfc000608; 

const frameBMask =  Oxfc00060c; 

const frameAOMask =  Oxff00; 

const frameAlMask =  OxOOff; 

const frameBlMask =  Oxff00; /*This sets constant mask to Oxf also */ 


WORD oldFrameAMask = * (WORD*) frameAMask; 


printf("Protecting with mask frame: "), 
Switch (frameNum) { 
case A0: *(WORD*)frameAMask = (oldFrameAMask & frameAQMask) ; 
puts ("A0"); 
break; 
case Al:  *(WORD*)frameAMask - (oldFrameAMask & frameAlMask); 
puts ("Al"); 
break; 


case Bl: * (WORD*) frameBMask - (frameBlMask ); 
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void 


pubst Blu 
break; 


default: 


puts("Error:setMask - 


rexit(); 


setAOIControl (void) 
/* Sets the video bus out of AOI mode. 
** Gee sect 3.9.4 in IMS Ref man 


p^ t 


const AOIControl = 


const disableAOI 


OxtcO00617; 


0x00; 


EUBYTE*)AOIControl 


void 


Illegal frame selected"); 


disableAOI; 


selectPage(IMSPage pageNumber) 
/* Selects between the different image frames and modules on the IMS board 


pt 


const 


const 
const 
const 
const 
const 


imsPageReg 


selectFrameAO0 
selectFrameAl 
selectFrameBl 
selectAM 
selectDM 


switch (pageNumber) 
case A0: *(WORD*)imsPageReg 
puts("Selecting Frame A0"); 
break; 
case Al: *(WORD*)imsPageReg 
puts ("Selecting Frame Al"), 
break; 
case B1: *(WORD*)imsPageReg 
puts("Selecting Frame Bi"); 
break; 
case AM: *(WORD*)imsPageReg 
puts("Selecting Acquisition module\n") ; 
break; 
case DM: *(WORD*)imsPageReg 
puts ("Selecting Display moduleWMn"); 


Oxfc000620 


OOOO 
0x0011; 
OXUOL3> 
0x0014; 
0x0015; 


( 


. 
+ 


= selectFrameA0; 


= selectFrameAl; 


= selectFrameBl; 


- selectAM; 


= selectDM; 
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break; 


void 

setIMSControl(void) 

/* Sets the IMS control register. See section 3.11 of the IMS hardware Ref 
man 

E X 

const imsControl = Oxfc000624; 


const FPSel = 0x0000; /* Sets the IMS to be master. */ 
const clockSpeed = 0x0004; /*Sets clock speed to be 20Mhz */ 
const DispMode = 0x00a0; /*DISPOE, ETMODE, DMEN, CBMR */ 


/* DISPOE(1): Enable display output. Not needed since DM is present 
a 
/* ETMODE(0): Define AM module trigger mode. */ 
/* DMEN (1): Enable image display */ 
/* CBMR (0): Do not clear the mask registers, This bit can be 
used to protect all frame bits */ 


* (WORD*)imsControl = (FPSel |clockSpeed | DispMode ) ; 
puts("IMS set 20Mhz, IMS:master, Display:enabled and in AM trigger 
mode \n") ; 


} 


void 

set FrameIRQ (void) 

/* The type of frame interrupt will be put here. 
** Currently not used. 

toL 

/* Empty function */ 

} 


void resetFrameCtrl(IMSPage frameNum) 

/* Resets the controls for horizontal pitch, tiling and write zoom for 
** frames AO, Al and Bl. See IMS Ref man 3.29, 3.34 

*/ { 


Oxfc000650; /* Frame AO and A1 control */ 
Oxfc00065a; /* Frame B1 control */ 


tI 


const frameACtrl 
const frameBCtrl 


tI 


/* Write (output) zoom */ 


const aUnPack - 0x0000; /* 0:normal ops, no packing of bits in 
RO, AL 7/ 
const verticalzZoom - 0x0000; /* No zoom, but a good project for someone. 


118 


Cl 
const horizontalzoomw - Ox0UODE 


/* Read (input) zoom) */ 
const bNoHorizZoom = 0x0000; /* No zoom: Avail 1 m o Fond ee, 
const bNoVertZoom 0x0000; 


2* Write (output) zoom = *7 

const bUnPack = 0x0000+./* 0:normal ops, no pacring OE Bases im Ble, 
const bWriteVertZoom = 0x0000; 

const bWriteHorizZoom - 0x0000; 


printf("Resetting frame: "); 
switch (frameNum) ( 


case AO: 
case Al: *(WORD*)frameACtrl = (aUnPack | verticalZoom | 
horizontalZoom) ; 
puts(" AO and A1"); 
break; 
case Bl: *(WORD*)frameBCtrl = (aUnPack | bUnPack | 
bNoVertZoom | bNoHorizZoom | 
bWriteVertZoom | bWriteHorizZoom ); 
puts NBI. 
break; 
default: 
puts("Error:resetFramePanScrolACtrl - Illegal frame selectedMn"); 
rexit(); 


void 
resetFramePanScroll(IMSPage frameNum) 
/* Resets a frame for no (zero) pan and scroll. See 3.21 of the IMS ref man 


B, d 


const a0ReadPan = 0xfc000640; 
const a0ReadScroll = 0xfc000642; 
const a0WritePan = 0xfc000644; 
const a0WriteScroll = 0xfc000646; 
const alReadPan = 0xfc000648; 
const alReadScroll - Oxfc00064a; 
const alWritePan = 0xfc00064C; 
const alWriteScroll = Oxfc00064e; 
const blReadPan = 0xfcC000652; 
const blReadScroll =  Oxtev00o 54 ; 
const blWritePan = 0xfc000656; 


const blWriteScroll 0xfc000658; 
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0x00; 
0x00; 


const zeroPan 
const zeroScroll 


printf("Setting pan and scroll to zero for frame: "); 
switch (frameNum) ( 


case A0: *(WORD*)aOReadPan - zeroPan; 
* (WORD*)aO0ReadScroll = zeroScroll; 
* (WORD*) a0WritePan - zeroPan; 
* (WORD*)aO0WriteScroll = zeroScroll; 
DUES E 
break; 
case Al: *(WORD*)alReadPan = zeroPan; 
* (WORD*)alReadScroll = zeroScroll; 
* (WORD* ) alWritePan = zeroPan; 
* (WORD*)alWriteScroll = zeroScroll; 
puts ("A1."); 
break; 
case Bl: * (WORD*)blReadPan = zeroPan; 
* (WORD* )blReadScroll = zeroScroll; 
* (WORD*)blWritePan - zeroPan; 
* (NORD*)blWriteScroll = zeroScroll; 
pucs BI 
break; 
default: 
puts("Error:resetFramePanScroll - Illegal frame selected"); 
rexit(); : 


void 

setXPortSwitch(void) 

/* Sets the cross-port switch for the application bus width and direction 
** This register must be set prior to setting any path registers 

** See AM Ref man sect 3.423 

E st 


unsigned int crossPortSwitch = 0xfc000670; 
const portConstant = 0x0007; 
SG CL at 
tor (1=07 1<8; i++){ /* Go through 8 words, 0x70->0x7f */ 


* (WORD*)crossPortSwitch - portConstant; 
crossPortSwitch += 0x00000002; 
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void 

setInputPath(IMSPage selectedFrame, INPUTPath imageSource) 

/* Selects the source of the image that will be put into a particular 
** frame. See AM Ref Man 3.40, 3.41 and 3.42 


EC 

const a0InputPath - Oxfc00066a; 
const allnputPath - Oxfc00066c; 
const bllInputPath - Oxfc00066e; 
const cameralnput = 0x00b8; 
const a0ZeroInput = 0x00c0; 


const constantlinput - 0x0090; 
const a00nesInput 0x00e0; 
const a0Input = 0x0288; 
const alInput Oro Je. 
const blinput 020201. 


switch(selectedFrame) ( 
Case AO: 
switch(imageSource) { 


case CAMERA: *(WORD*)a0InputPath - cameraInput; 
break; 

case AOZERO: *(WORD*)a0InputPath = a0ZeroInput; 
break; 

case CONSTANT: *(WORD*)a0InputPath - constantInput; 
break; 

case AOONES: *(WORD*)aOInputPath - a00nesInput; 
break; 

case INAO:  *(WORD*)aOInputPath - a0Input; 
break; 

case INA1:  *(WORD*)aOInputPath - alInput; 
break; 

case INB1:  *(WORD*)aOInputPath - blInput; 
break; 

default: 

puts("Error:setInputPath - Illegal input for frame AO selected."); 
rexit(); 
} 
break; 
case Al: 
switch(imageSource) ( 
case CAMERA: * (WORD*)alInputPath = cameralInput; 
break; 
case CONSTANT: *(WORD*)allInputPath - constantInput; 
break; 
case INAO: * (WORD*)alInputPath = a0Input; 
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break; 


case INAI: * (WORD*)allnputPath - alInput; 
break; 
case INBl: * (WORD*)allInputPath - blInput; 
break; 
default: 
pubs Error: setinputrarh = Illegal input for frame A1 selected. 2). 
rexit(); 
) 
break; 
case Bl: 
switch(imageSource) ( 
case CAMERA: * (WORD*)blInputPath - cameraInput; 
break; 
case CONSTANT: *(WORD*)blInputPath - constantInput; 
break; 
case INAO: * (WORD*)blInputPath = a0Input; 
break; 
case INAI: * (WORD*)blInputPath - alInput; 
break; 
case INB1: “(WORD )blinputrPath -wvblIInput: 
break; 
default: 
puts ("Error:setInputPath - Illegal input for frame B1 selected."); 
rexit(); 
) 
break; 
default: 
puts("Error:setInputPath - Illegal destination frame selected."); 
rexit(); 


void 

setFrameAcquire(IMSPage frameNum, ACQUIREType typeOfAcquire) 

/* controls the acquistion to frame AO, Bl or Al 

** The input cross port switch should be set prior to calling this func. 
** Decision was made to have actual acquistions triggered by the 

** acquisition enable register (3.19 Ref man) 


XU 

const frameA0Acq = 0xfc000630; 
const frameAlAcq = 0xfc000632; 
const frameBlAcq = 0xfc000636; 


const triggerMode - 0x00; /* No wait for trigger from AM */ 
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const waitAcq - 0x02; /* prevent acquisition till acqEnable is written 
ul 


WORD  acquireMode; 


switch(typeOfAcquire) ( 
case SNAP: 
acquireMode - 
break; 
case GRAB: 
acquireMode 


0x0080; /*Make this a snap operation (one picture) */ 


0x00c0; /*Make this a grab operation (continuous 
snap) */ 


break; 

case FREEZE: 
acquireMode - 0x0000; 
break; 

default: 


/* Stop taking pictures */ 


puts("Error:setFrameAcquire - Illegal type of acquire selected. "); 
puts("Stopping grab or snap, if enabled\n"); 
acquireMode = 0x0000; 
break; 


Paamctit( Setting Acquistion controls for "); 
Switch (frameNum) ( 


case AO: while ( (*(WORD*)frameAOAcq & 0x0010)) 


* (WORD*) £ÉrameAO0Acq = (triggerMode | waitAcq lacquireMode ); 
puts ("Frame AO "); 
break; 


case Al: while ( (*(WORD*)frameAl1Acq & 0x0010)) 


t 


* (WORD* ) frameAlAcq = (triggerMode | waitAcq lacquireMode ); 
puts ("Frame Al "), 


break; 


case B1: while ( (*(WORD*)frameBlAcq & 0x0010)) 


. 
t 


* (WORD* ) frameBlAcq - (triggerMode | waitAcq lacquireMode ); 
puts("Frame Bl "); 


break; 

default: 
puts("Error:setFrameAcq - Illegal frame selected."); 
Best 

) 

puts ("awaiting AM trigger and acquistion enable\n"); 
} 
void 


acqEnable (void) 


/* This register controls the synchronous acquisition into the IMS 
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** frame stores (see IMS ref man 3.19) This enables acquisition into the 
** frame stores when an acquire is pending in the IMS acquisition registers 
** and the frames waitAcq is set 

** For system reset use: IV-SPRC > ex fffc00e3 

= REE ECOUDES: OXxFf ? EQ 

PET 

const frameAcqEnable = 0xfc000634; 


const enable = 0x0000; 


* (WORD* ) frameAcqEnable = enable; 
puts("IMS enabled for image acquistion.\n"); 


) 


Jr ae re ee A ARO A A A dd pe de E 
es F .UENAME: imagelog.h 

ls AUTHOR: Leonard V. Remias and Khaled Morsy 

l= some fragments from Kelbe 

[= DATE: OiMarch 1996 


#ifndef _ _IMAGELOG_H 
tdefine __IMAGELOG_H 


ES 
Must be called prior to turning on image logging. This makes 
image logging two steps. This must be, since we cannot depend 
on static variables being properly initialized on Yamabico 
for subsequent runs. 

a 

void InitImagelog (void); 


Tae 
Function prepares the tracing system to log data. 
The tracing frequency specifies how many image control cycles are 
skipped before a data point is logged. A value of 1 or less causes 
the logging to occur each cycle. 
The filename is the name of the file to create on the host. If NULL 
is passed in, a default name is used. 
The buffer size specifies how many bytes of storage to allocate to 
Save the data. If a value of 0 is specified, a default size is used. 


Tracing is automatically turned on after this call. 

The simplest way to call this function and have image logging is: 
InitImageLog(NULL, 0); 
This will use all of the default values, and should work fine for most 


AOS 
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27 

void ImageLog (char *Filename, int BufferSize); 

E 
Function enables data logging. Frequency is used by the 
system's logging functions to determine the number of image 
control cycles between logged data. For example, if the 
frequency is 3, then data would be logged on every third call 
to LogTimedImage() or LogImageData(). Use this to change 
the logging frequency. 

By 


a RE EE Re Re EE IR TERA TE EE NR Ee Rda dd RR 


eg FILENAME: imagelog.c 

put AUTHOR: Leonard V. Remias and Khaled Morsy 

s some fragments from Kelbe 

A DATE: OlMarch 1996 

"^ PURPOSE: Prepare the system for image logging 
Eg 


Sumelude "definations-b* 
tinclude "imagelog.h" 
tinclude "stdiosys.h" 
tinclude "trace.h" 


Cr Local variables  ***/ 


static IOhandle LogHandle; 


Static int Enabled; 
px Code EER 
void 


InitImagelog (void) 
( 
LogHandle EOF; 


Enabled = 0; 


void 
ImageLog(char *filename, int bufSize) 
( 
if (bufSize <= 0) 
bufSize = IMAGELOGSIZE; /* if not specified, use the default */ 


i (filename == NUDLI) 
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filename = IMAGELOGFILE; 


LogHandle - IOopenimage(filename, bufSize) ; 

TreTogHaudie == EOF la 
printf ("\nError initializing image logging file $sWMn", filename); 
return; 


} 
Enabled = 1; 


void 
Logimage (YAMAIMAGE blimage) 


{ 
Inen 


/* checking LogHandle here is not really necessary, but saves a function 
call */ 


if (Enabled) 
for(i=0; i<476; i++) 
{ 
for ( j= eas, ost) 


{ 


IOprintf (LogHandle, "d\n", blimage.image[i]{j]); 
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